Mirendil logo
Posted 2mo agoSan Francisco

Member of Technical Staff, Model Evaluation

staffOn-site (San Francisco)Salary undisclosed
Job Description

Mirendil

Mirendil is a tech-first company focused on solving core bottlenecks that unlock step-change acceleration across science and technology. Our first goal is to democratize frontier AI R&D across scientific disciplines. We are building a frontier AI research company and training our own models end-to-end.

The Role

We are looking for a research engineer to build the evaluation infrastructure that tells us whether our models are getting better in ways we care about. You'll own the frameworks, pipelines, and tooling that measure model behavior across capabilities. Some example areas you might work on (not limited to):

  • Design and build evaluation frameworks that measure model capabilities along realistic axes, beyond standard benchmarks.

  • Build automated eval pipelines and regression-detection systems that run continuously and surface signal quickly.

  • Develop agent-assisted workflows for humans to efficiently inspect model behavior.

  • Instrument training runs with observability tooling so researchers can understand what's changing in model behavior, and why.

Similar Openings in Other

View all in category