I
Posted 2mo agoSingapore

Member of Technical Staff, Kernel Engineering

staffSingaporeSalary undisclosed
Required Skills
Python
Job Description

Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware—a position that took years to build.

About the Role

We're looking for a performance engineer to squeeze every FLOP out of modern accelerators. You'll write the kernels and low-level optimizations that make vLLM the fastest inference engine in the world. Your code will run on hundreds of accelerator types, from NVIDIA GPUs to emerging silicon. When hardware vendors develop new chips, they integrate with vLLM. You'll work directly with these teams to ensure we're extracting maximum performance from every generation of hardware.

Skills and Qualifications

Minimum qualifications:

  • Bachelor's degree or equivalent experience in computer science, engineering, or similar.

  • Deep experience writing CUDA kernels or equivalent (CuTeDSL, Triton, TileLang, Pallas).

  • Strong understanding of GPU architecture: memory hierarchy, warp scheduling, tiling, tensor cores.

  • Proficiency in C++ and Python with demonstrated

Similar Openings in Other

View all in category