What You’ll Do

• Build and maintain batch and streaming data pipelines.

• Move production data into archival/data lake storage safely and observably.

• Improve quality, reliability, and observability of derived datasets.

• Design validations for freshness, completeness, schema correctness, and data quality.

• Build reusable datasets that reduce one-off data extraction and aggregation work.

• Optimize queries and data processing jobs for correctness, latency, and cost.

• Prototype in the right tools, then integrate scoped production experiments with amo’s systems where needed.
  
  

Must Have

• Senior-level experience building and operating data pipelines.

• Strong Python and SQL.

• Production experience with Python or Scala.

• Experience with PySpark, Spark SQL, Spark Streaming, Parquet, and Iceberg.

• Strong understanding of batch and stream processing.

• Query optimiza