Member of Technical Staff — Performance
About the Role
RadixArk is hiring a Member of Technical Staff — Performance in Palo Alto, CA — someone who can push LLM inference and training systems to the limit across real production workloads.
You’ll work on the performance-critical path of SGLang, Miles, and the RadixArk infrastructure stack: latency, throughput, GPU utilization, memory efficiency, scheduling, batching, kernel behavior, distributed execution, and cost-per-token. This is not a generic benchmarking role. You’ll be working on the systems that determine whether frontier-scale AI workloads are actually usable, affordable, and reliable in production.
Our customers care about real numbers: P99 latency, TTFT, tokens/sec/GPU, throughput under long-context workloads, cost-per-million tokens, RL rollout efficiency, and training-inference consistency. You’ll help us measure, debug, and improve these systems across NVIDIA, AMD, Google TPU, and cloud partner environments.
This role is for someone who loves performance debugging, understands that small systems details can create massive product impact, and wants to work at the frontier of AI infrastructure.
What You'll Do
- Analyze and improve performance across SGLang, Miles, and RadixArk production deployments
- Benchmark LLM inference and training wor
