What you'll do
- Build and run ingest pipelines for ERA5 (Copernicus), GFS/GEFS (NOAA) and ECMWF open data
- Design how forecast data is stored (Zarr on object storage) so it is cheap to keep and fast to read
- Handle GRIB2 decoding, partial or late model runs, and backfills without anyone babysitting them
- Bring NEXRAD radar into a near-real-time path for rain nowcasting
What we look for
- Production experience with large datasets and scheduled pipelines, where a silent failure is a real outage
- Python, object storage (S3 or similar), and a workflow scheduler such as Airflow or Prefect
- Experience with scientific formats (NetCDF, GRIB, Zarr) is a strong plus, but not required
- Instinct for where the cost sits — storage, compute and data transfer
https://www.ensemblegains.com/careers/data-engineer
JLara@ensemblegains.com
Service@ensemblegains.com
Source: Wellfound.
Report this job
Wrongly listed? Tell us why.