Senior Software Engineer, AI Gateway
Are you ready to unlock intelligence?
If you don’t think you meet all of the criteria below but are still interested in the job, please apply. Nobody checks every box - we’re looking for candidates that are particularly strong in a few areas, and have some interest and capabilities in others.
The Mission
The AI Gateway team is at the forefront of Kong's evolution into the Agentic Era, building the critical infrastructure that connects enterprises to the world of generative AI. We are architecting a highly performant, secure, and observable gateway that provides developers with an unparalleled 'Developer Delight' experience for AI workloads. Your work will directly empower our customers to innovate faster by securely integrating LLMs and AI services into their applications at massive scale.
What You’ll Do
Design and own core components of our AI Gateway, ensuring 99.99% uptime and low-latency performance for critical AI traffic.
Lead the implementation of features like prompt engineering, caching, and observability for AI services, writing clean, maintainable Golang and/or Python code.
Influence the technical roadmap
