healpix-convert#
healpix-convert converts various datasets into the
HEALPix-based DGGS format proposed by
GRID4EARTH.
It takes input data stored in Zarr format (one or more EOPF-compliant Zarr datasets), then reprojects and resamples it onto a HEALPix grid, outputting a new Zarr dataset compliant with the DGGS Zarr and CF-HEALPix conventions.
Warning
This package is under heavy development. The API is not stable yet.
Supported data products#
ERA5
ClimateDT
CAMS
Key features#
Multiple resampling methods — nearest, bilinear, k-nearest neighbors, PSF, cell-point (provided by healpix-resample)
Multi-stage workflow — first prepare the output dataset, then run data conversion in parallel jobs, defined as the tasks of a workflow orchestration tool (Prefect, Airflow, Argo Workflows, etc.)
HEALPix pyramids — generate coarser refinement levels in a converted dataset, for viewers that pick the level from the zoom
Dask-native — parallel conversion out of the box with a distributed Dask cluster
Cloud-ready — read from and write to S3 object stores
STAC metadata — input STAC discovery attributes are propagated and merged in the output
Zarr conventions — Zarr conventions are used for structuring metadata in the output dataset
The conversion workflow step by step: settings, staging cache, output preparation and conversion.
Conversion settings, parallel conversion with Dask, S3 object stores and the metadata written in the output dataset.
Example notebooks converting ERA5, CAMS, ClimateDT and ESA CCI land cover data.
Complete documentation for every public function and class.