Finding and downloading data
Many data resources can be accessed through the file download endpoint
Available data
File download access is available for all public data on HDX. Any dataset resource that exposes a download_url can be retrieved programmatically, regardless of whether the data is tabular, geospatial, or provided in another file format like zip folders.
This includes CSV and Excel files, geospatial formats, zipped folders, and other common data files hosted on HDX, as well as redirect you to from resources that have externally hosted data. Availability and structure varies by data contributor, and datasets may include multiple resources with different formats or purposes.
Finding and downloading data
Data on HDX can be discovered either through the web interface or programmatically via the metadata API endpoint (package_search). Both approaches reference the same underlying data.
Finding the data via the HDX UI
You can identify downloadable files directly from HDX.
Navigate to a dataset page on HDX. Each dataset lists one or more resources which contain the data itself. For each resource, you will see the resource name, file format, a More Information button and a Download button.
Select the resource you want to work with by clicking the More Information button, screenshot below. Here you can see, where available, the resource preview, data dictionary and API access information.
Once on the resource page, the URL listed is the file download endpoint for that particular resource.
Finding the data via the HDX Metadata API
Downloadable file URLs can also be discovered programmatically using the HDX metadata endpoints.
Query the dataset metadata endpoint (package_show or package_search) to retrieve the dataset object. In the response, inspect the resources array. Each entry represents a single resource and includes metadata such as id, name, format, and download_url.
Identify the resource that corresponds to the data file you want to retrieve. Datasets may include multiple resources, such as data files or codebooks. Once identified, use the download_url field from that resource object to download the file programmatically.
See example below for the package_show query using the Global Pcodes dataset on HDX. https://data.humdata.org/api/action/package_show?id=global-pcodes
Last updated
Was this helpful?