Problem Design Engineer
What We’re Building
We create high-quality coding problems for training AI models — drawn from real production repositories, not synthetic puzzles. Your role is to ensure these problems are fair, clear, and technically sound.
The Role
Part-Time Code Quality Reviewer | Remote | $40/hr | 0-25 hrs/week
We’re looking for engineers who can trace the intent behind a code change, understand what changes were made and why, and express that clearly in natural language.
This is judgment work, not mechanical testing. You'll make philosophical decisions about fairness and clarity in technical contexts.
What You'll Actually Do
Review code changes across unfamiliar repositories and tech stacks
Assess problem fairness: Could a skilled engineer solve this with only the given context?
Evaluate test quality: Do tests properly validate the intended solution?
Write clear justifications for your assessments (2-3 sentences per decision)