Snorkel AI logo
Posted 1mo ago•New York City, NY (Hybrid); San Francisco, CA (Hybrid); United States (Remote)

Director, Research - Evaluation & Training

directorRemote€11,900 – €16,500 / mo
Required Skills
Next.jsLLMs
Job Description

About Snorkel

Snorkel AI is the frontier AI data lab, helping teams build the data and environments behind high-performing frontier and agentic AI. We combine technology with research-driven AI data development to create datasets, benchmarks, evals, and custom solutions for real-world AI systems. Founded out of the Stanford AI Lab in 2019, Snorkel works with leading AI labs and enterprises to move from better data to better outcomes. 

Excited to help us redefine how AI is built? Apply to be the newest Snorkeler!

ABOUT THE ROLE 

We're looking for a manager to lead a team of researchers to focus on data evaluation, error analysis and data valuation methods to predict model performance. This team is responsible for showcasing the value and quality of Snorkel’s data for model training and evaluation, understanding where today's frontier models fall short, and turning that understanding into a point of view on what benchmarks and datasets these models will benefit from. 

You and your team will be responsible for Snorkel’s data design flywheel by analyzing model failures, finding capability and skill gaps in current models, suggesting the next benchmarks to invest in and then proving the value of this data for our customers. &

Similar Openings in Other

View all in category➔