DevOps Engineer (Databricks-based Data as a Product Platform)

We are seeking a DevOps Engineer to own the CI/CD pipelines and infrastructure-as-code practices that power our Data as a Product (DaaP) Platform, built on Databricks (AWS). This role is primarily focused on designing and building robust CI/CD pipelines for deploying and operating our Databricks-based DaaP Platform — automating deployments, managing environments through config-as-code, and integrating with observability, AI, and cloud tooling (Datadog, Claude/Anthropic, AWS native services) to give data and engineering teams a fast, reliable, and self-service platform experience.

Main responsibilities:

• Design, build, and maintain CI/CD pipelines as the core focus of this role — enabling reliable, repeatable deployment of the Data Platform and its workloads/jobs/infrastructure on Databricks and AWS
• Manage platform environments (workspaces, clusters, jobs, permissions, and related AWS resources) as code using Terraform and/or config-as-code approaches
• Implement GitOps practices for infrastructure and platform configuration, ensuring changes are version-controlled, reviewed, and auditable
• Build and maintain integrations between the Data Platform and third-party platforms (Datadog for observability/alerting, Claude/Anthropic for AI-assisted workflows, and other SaaS/AWS services)
• Automate provisioning, scaling, and lifecycle management of AWS resources supporting the Data