Senior Data Engineer
About the Role
Join an early-stage data infrastructure company building a platform that transforms information from multiple sources into reliable, current company intelligence. You will own the data platform end to end, from architecture and ingestion through production operations, helping ensure trusted data powers downstream products.
What You'll Do
Design and build a multi-source platform for concurrent ingestion, event-driven processing, and orchestrated batch workflows.
Develop resilient intake from provider APIs, webhooks, files, and web scraping, including rate limits and failure handling.
Orchestrate scheduled workflows and historical backfills with tools such as Airflow, Dagster, or Prefect.
Build event-driven processing with messaging or task queues, including retries, dead-letter queues, and controlled replay.
Store original payloads in Google Cloud Storage and use dbt to transform data into raw, standardized, and curated layers.
Implement idempotent upserts, data contracts, automated validation, pipeline tests, and monitoring for freshness and failures.
Design and optimize PostgreSQL schemas and loading patterns for downs
