Senior Data Engineer - AWS & Databricks (Public Sector)
At Xtremax, we're looking for a Senior Data Engineer to design, build and operate dependable data pipelines and reusable data products on AWS and Databricks. You'll help establish the data foundations that support analytics, reporting and machine learning, ensuring that information remains reliable, well-governed and ready for production use.
You'll lead engineering work across data ingestion, transformation, modelling, quality validation, orchestration, lineage and performance optimisation. Using Python, PySpark, SQL, Apache Spark and Delta Lake, you'll build production-grade pipelines that handle complex data sources, incremental updates and operational recovery while maintaining clear data contracts and ownership.
This role combines hands-on engineering with technical leadership. You'll work with data owners, analysts, data scientists, architects and platform teams to translate business needs into maintainable data solutions, improve engineering standards and develop reusable patterns that make data services easier to operate and scale.
Responsibilities
- Lead the design and implementation of reliable batch and streaming pipelines across AWS and Databricks.
- Build lakehouse architectures using Delta Lake and layered Bronze, Silver and Gold data patterns.
- Develop reusable data models, curated datasets and data products with clear definitions, ownership and service expectations.
- Implement source i