ML Infrastructure Engineer
About the Role
This is a hands-on infrastructure engineering role at an early-stage enterprise AI company building a context and data governance layer for AI agents deployed in highly regulated industries. You will own the inference and model-serving infrastructure end to end, making production AI agents fast, reliable, and scalable as concurrency grows.
What You'll Do
Design, build, and own inference and model-serving infrastructure from initial architecture through production deployment.
Scale systems that enable AI agents to run reliably and efficiently under increasing concurrent load.
Identify and resolve infrastructure bottlenecks in collaboration with ML and platform engineering teams.
Drive performance optimization across latency, throughput, and reliability for production workloads.
What We're Looking For
5+ years building and operating ML inference systems, model-serving platforms, or ML infrastructure in production environments.
Hands-on experience designing and scaling inference-serving systems using frameworks such as TensorFlow Serving, TorchServe, Triton, KServe, or equivalent custom solutions.
