Staff Rust Developer
.txt builds structured generation: we make language models produce output that follows a given format, by deciding at every decoding step which tokens are allowed. We compile a JSON Schema, a regex, a grammar, a list of function definitions or a policy into that decision, fast enough to run inside the decoding loop. This is how .txt builds reliable and safe agents. We're looking for a developer to work on the parsers and compilers at the center of it.
The Role
.txt builds structured generation: we make language models produce output that follows a given format, by deciding at every decoding step which tokens are allowed. We compile a JSON Schema, a regex, a grammar, a list of function definitions or a policy into that decision, fast enough to run inside the decoding loop. This is how .txt builds reliable and safe agents. We're looking for a Rust developer to own the part of it that has to be fast: the automata, indexes and parsers that run at every decoding step. You'd turn what the rest of the team writes into production-ready Rust, with the Python bindings and C++/CUDA glue to put it inside an inference engine, and the benchmarks to prove it stays fast.
