Senior Engineer, Data Platform

As a Senior Data Platform Engineer, you will build and operate the data infrastructure that supports Zeta’s products, analytics, machine learning, and AI systems.

This is a broad platform role. Engineers on the team take ownership across Lakehouse architecture, distributed compute, data quality, governance, lineage, security, access controls, and the operational systems that keep the platform running. Individual focus areas will change with team priorities, and you will contribute across the platform as needed. 

The team also develops tooling for type-safe, testable data pipelines and operates Spark workloads on dynamically sized Hadoop clusters backed by EC2 Spot instances. We work closely with data engineers, data scientists, infrastructure teams, and product teams to make data dependable, easy to find, secure to use, and cost-effective to process.

 

 Responsibilities:

• Build and operate Lakehouse, Spark, and distributed data-processing systems. 
• Improve the performance, reliability, cost, and operational visibility of platform workloads. 
• Develop capabilities for data quality, governance, lineage, metadata, discoverability, security, and access control.