Mid-Level Research Engineer, QC Automation

About the Role

Join the engineering and research team at an early-stage AI evaluation infrastructure startup, building quality control systems for training data used in reinforcement learning. This role is central to scaling reliable data quality through human judgment, clear standards, and practical automation.

What You'll Do

• Build and improve scalable systems that automate quality control for training data.

• Define and enforce data quality standards using human judgment and domain understanding, without relying heavily on large language models.

• Design experiments and metrics to evaluate agent outputs and training data.

• Work with data vendors to investigate quality issues, diagnose agent failures, and provide actionable feedback.

• Turn quality findings into sampling strategies, audits, and rule-based or model-assisted validation pipelines.

• Integrate quality checks into internal tools and vendor workflows to reduce anomalies and edge cases.

What We're Looking For

• Two to four years of experience in research engineering or a related technical role focused on quality control automation.