AI/ML Engineer
About the Role
Join an AI/ML team building tools to make production AI agents more reliable. You will own the intelligence that identifies agent failures, assesses confidence, and checks whether proposed fixes work.
What You'll Do
Detect subtle failures, including omissions, compliant but incorrect responses, and patterns that emerge across large volumes of traces.
Turn user behavior signals, such as rephrasing, abandonment, and retries, into evidence of agent failures.
Build evaluation methods to measure detection precision when labeled ground truth is limited or unavailable.
Make patch generation trustworthy by reproducing failures, verifying proposed fixes, and avoiding low-confidence changes.
Improve the cost efficiency of detection, choosing appropriate models and approaches for each event.
Review production customer traces regularly to identify problems and opportunities for improvement.
What We're Looking For
Demonstrated AI/ML engineering experience; candidates with 0 to 10 years of experience are welcome, including new graduates and people without a traditional degree.
