Newcode.ai logo
Posted 1y agoRemote

Senior FastAPI Developer

SeniorRemoteSalary undisclosed
Required Skills
PythonPostgreSQLRedisSQLLLMsFastAPILangChain
Job Description

Who are we?

We build AI tools for firms in legal and professional services: software people use for real work, not demos. We started a few months ago and already have paying clients who rely on what we ship. The team is small and moving fast.

The role

You'll own the backend behind our AI features. That's the APIs, the data pipelines, and the orchestration sitting between our product and the language models doing the work. In practice it means running retrieval over large sets of documents, getting dependable results out of LLMs and their tool calls, streaming responses to the UI, and processing long jobs in the background without things falling over. 


It isn't CRUD work. The hard parts here are keeping AI systems accurate and fast with confidential data, at production scale. You'll make architecture calls early and live with them.

Requirements

What You'll Do

  • Designing and building the APIs and services our products run on. 
  • Working on the AI plumbing: retrieval, orchestration, tool-calling, response streaming, and the evals that tell us whether the output is any good. 
  • Keeping async and distributed work reliable: document ingestion, embeddings, and long-running jobs on Redis. 
  • Building integrations with the systems clients already use, like email and document stores, and m

Similar Openings in Backend

View all in category