Senior Data Engineer

Role Overview

• We are seeking a hands-on Databricks engineer with deep technical expertise in building, operating, and optimizing Lakehouse-based data and AI solutions. In this role, you will design, develop, and operationalize Delta Lakehouse architectures that deliver measurable outcomes for enterprise customers. You will own implementation activities, contribute to technical delivery leadership, and mentor engineering teams in best practices across data engineering, platform governance, and AI.

Key Responsibilities

• Design, build, and maintain scalable data pipelines using Delta Live Tables (DLT) / Lakeflow Spark Declarative Pipelines, Spark SQL, Python, or Scala.
• Optimize batch ETL, streaming, and machine-learning workloads for performance, cost efficiency, scalability, and reliability.
• Configure and administer Databricks workspaces, Unity Catalog, cluster policies, SQL Warehouses, access controls, and secure governed environments.
• Automate infrastructure provisioning and application deployments using Terraform, Git, and CI/CD pipelines.
• Establish platform observability, monitoring, alerting, and cost-management practices using tools such as Splunk, Prometheus, or AWS CloudWatch and equivalent cloud-native tools.
• Collaborate with customers and cross-functional teams to deliver AI/LLM solutions using MLflow, Mosaic AI, and relevant Databricks model-serving and evaluation capabilities.
• Troubl