Senior Data Engineer

About the Role

Join a data infrastructure team building a platform that turns information from multiple sources into reliable, up-to-date company intelligence. You will own the platform end-to-end, from architecture and ingestion through production operations, helping power downstream products with trusted data.

What You'll Do

• Design and build a multi-source data platform for concurrent ingestion, event-driven processing, and orchestrated batch workflows.

• Develop intake pipelines for provider APIs, webhooks, files, and web scraping, with rate limiting and robust failure handling.

• Orchestrate scheduled workflows and historical backfills using tools such as Airflow, Dagster, or Prefect.

• Build event-driven systems with messaging or task queues, including retries, dead-letter queues, and controlled replay.

• Preserve original payloads in Google Cloud Storage and transform data with dbt into raw, standardized, and curated layers.

• Implement idempotent upserts, data contracts, automated validation, pipeline tests, and monitoring for freshness and failures.

• Design and optimize PostgreSQL schemas and loading patterns, and integrate enrichment pr