Senior Distributed Systems Engineer

About the Institute of Foundation Models The Institute of Foundation Models (IFM) designs and operates ultra-scale GPU supercomputing systems to train next-generation foundation models. We believe performance, fault tolerance, and scalability are co-designed across model architecture, communication systems, runtime, and hardware topology. This role sits at the core of that effort — driving communication performance, distributed reliability, and cross-layer optimization for large-scale training workloads.   The Mission We are looking for a deeply technical engineer to co-design and optimize the communication stack for large-scale distributed training, including hybrid parallelism and Mixture-of-Experts (MoE) workloads. This is not a network operations role. This is a systems-level engineering position focused on performance engineering, distributed debugging, and communication-runtime co-design. ·       Design and optimize expert-parallel and hybrid-parallel communication patterns ·       Drive high-performance hierarchical collectives for MoE workloads ·       Co-design runtime orchestration with communication topology awareness ·       Reduce tail latency and improve determinism across thousands of GPUs ·       Architect fault-tolerant distributed execution under real-world cluster failures Core Technical Scope ·       Communication-compute overlap and topology-aware collective optimization ·       Deep debugging of NCCL, RDMA, and custom communication layers ·       Hybrid