Digitalocean98 logo
Posted 1mo ago•Seattle

Staff Engineer, Serverless Inference

staffOn-site (Seattle)Salary undisclosed
Required Skills
GoNext.jsKubernetesLLMs
Job Description

Dive in and do the best work of your career at DigitalOcean. Journey alongside a strong community of top talent who are relentless in their drive to build the simplest scalable cloud. If you have a growth mindset, naturally like to think big and bold, and are energized by the fast-paced environment of a true industry disruptor, you’ll find your place here.  We value winning together—while learning, having fun, and making a profound difference for the dreamers and builders in the world. 

We are seeking a Staff Engineer to implement and contribute to the design and optimization of our Serverless Inference infrastructure and APIs. In this role, you will tackle the challenges of large-scale AI workloads, focusing on throughput, GPU utilization, and fault tolerance to support next-generation inference needs of AI native enterprises.

What You'll Do:

  • Design and build scalable, multi-tenant services that power AI inference and intelligent routing workloads.
  • Strengthen platform resiliency through improved observability, capacity management, automation, and operational tooling.
  • Partner closely with platform, GPU infrastructure, and product engineering teams to deliver production-grade systems and highly available APIs.
  • Raise the engineering b

Similar Openings in Other

View all in category➔