Research Engineer, QC Automation
About the Role
Join an early-stage AI evaluation infrastructure startup as a Research Engineer focused on quality control automation. You will help build systems that make high-quality training data more scalable, combining careful human judgment with reliable measurement and automation.
What You'll Do
Build and improve quality control systems for training data created within reinforcement learning environments.
Define quality standards and design experiments and metrics to assess agent outputs.
Develop auditing approaches, including sampling strategies and rule-based or model-assisted validation pipelines.
Work with data vendors to diagnose quality issues, understand agent failure modes, and improve data generation processes.
Turn quality control findings into improvements to internal infrastructure and vendor-facing tools.
What We're Looking For
Two to four years of experience in a research engineering or similar role, including hands-on work in quality control automation.
Proficiency with Python, Docker, and Linux, plus experience building scalable data validation and automated QA/QC system
