Lead Research Engineer, Data Quality
About the Role
Lead the data quality team at an early-stage AI company, building systems to measure and improve training data for AI agents. Your work will shape how teams evaluate data across reinforcement learning environments, synthetic datasets, benchmarks, and domain-specific workflows.
What You'll Do
Set data quality strategy and build systems to evaluate thousands of tasks across varied data sources and workflows.
Develop scalable synthetic data validation methods, including failure-mode analysis, task mutation checks, and trajectory auditing.
Design metrics, experiments, quality standards, and processes for evaluating agent outputs.
Work with research engineers, domain experts, and data vendors to diagnose quality issues and improve data generation.
Turn research insights into production tools, dashboards, validation pipelines, and feedback loops.
Mentor research engineers and strengthen technical rigor across the team.
What We're Looking For
At least 5 years of research or engineering experience building AI/ML data evaluation or quality systems.
