Data Platform Engineer
QED (https://qed.ai) is a tech company focused on public health and food security in Sub-Saharan Africa. We build the digital infrastructure and AI used at the intersection of aid and scientific inquiry, including surveillance of HIV/malaria/TB, and nutrient analysis of crops and soils, working at national-scale in several African countries. Our funding comes from multiple philanthropic and governmental organizations, including the Global Fund, Gates Foundation, and the CDC.
We are looking for a mid/senior Data Platform Engineer (backend) to join our team in Warsaw. Desired skills include:
experience designing and maintaining data pipelines using ETL and/or ELT approaches, with the ability to reason about trade-offs rather than defaulting to a single pattern
understanding of data pipeline reliability concepts, including idempotency, backfills, and handling late or corrected data
ability to structure data systems into clear layers (e.g. raw, cleaned, curated) and reason about their different purposes and guarantees
experience deciding between batch, micro-batch, and streaming approaches based on latency
