MakerMaker logo
Posted 4mo ago•San Francisco

INFERENCE ENGINEER

MiddleOn-site (San Francisco)Salary undisclosed
Required Skills
PythonNode.js
Job Description

ABOUT THE COMPANY

We're building autonomous research agents for recursive self-improvement (multi-agent systems that propose, run, and analyze machine learning experiments). We're a small team based in San Francisco, on-site

ABOUT THE ROLE

You build and operate the inference systems that serve our models in production. The work spans serving infrastructure, runtime optimization, and the long tail of production infrastructure that come with running real workloads.

This is an engineering role, not a research role. You'll measure, profile, debug, and ship. You'll work alongside researchers, but your job is to make their work fast and reliable in production. Real ownership, real autonomy.

WHAT YOU'LL DO

  • Build, operate, and harden production inference systems serving large models at high throughput

  • Own the performance characteristics of those systems end-to-end: throughput, latency, cost-per-token, reliability under load

  • Profile real workloads to identify bottlenecks; ship fixes that move the metric you set out to improve

Similar Openings in Other

View all in category➔