C
Posted YesterdayKondapur, Telangana, India

Data Engineer

MiddleOn-site (Kondapur)Salary undisclosed
Required Skills
PythonAzureKubernetesDockerTerraformKafkaSQLCI/CDDatabricksApache Spark
Job Description

Coretek is looking for a Data Engineer to build and operate the pipelines and data models that the rest of the business runs on. You'll own ingestion from source systems through to curated, well-documented datasets that analysts, data scientists, and application teams depend on. This is a hands-on engineering role: you'll write production code, design schemas, and be accountable for the reliability and cost of what you ship.

Responsibilities

  • Design, build, and maintain batch and streaming data pipelines that are idempotent, observable, and recoverable.
  • Model data for analytics (dimensional models, semantic layers, and curated marts), balancing query performance against maintainability.
  • Integrate data from operational databases, SaaS APIs, files, and event streams, including handling schema drift and late-arriving data.
  • Build data quality checks (freshness, volume, uniqueness, referential integrity) into pipelines rather than bolting them on afterward, and define how failures alert and escalate.
  • Own pipelines in production: monitoring, on-call rotation for data incidents, root-cause analysis, and backfills.
  • Tune performance and cost (partitioning, clustering, file sizing, warehouse and cluster sizing) and make the tradeoffs explicit.
  • Apply engineering discipline to data: version control, code review, CI/CD, automated testing, and infrastructure as code.
  • Implement access controls, PII h

Similar Openings in Data & Analytics

View all in category