Member of Technical Staff | Inference Platform
About the role
At Avra, every technical IC is a Member of Technical Staff (MTS). The title doesn't put anyone in a silo: you own systems and outcomes, not steps in a function, and you keep building depth in your area. Seniority shows up in your scope, level, and compensation, not in titles.
In this role, you'll join the Platform team to own where our models execute. Customers consume our models through large batches of millions of records and through real-time APIs, and they make business decisions on every response. You'll run governed model releases reliably and efficiently — in our cloud and on customer-hosted Kubernetes — and make inference fast, predictable, and cheap enough to serve both enterprise and mid-market customers.
What you'll do
Evolve Sophos, our online and batch inference runtime, built on Kubernetes.
Run large batch inference on ephemeral jobs, with multi-dimensional admission control (CPU, memory, GPU) through Kueue.
Build and extend the Sophos controller and its Kubernetes custom resources.
Optimize each model's inference engine and feature processing, using vectorized, columnar operations.
Serve graphs and data efficiently
