Pluralis Research logo
Posted 2w agoSan Francisco

Research Engineer - Post-Training

MiddleOn-site (San Francisco)Salary undisclosed
Required Skills
PythonPyTorchLLMs
Job Description

Pluralis Research works on Protocol Learning: training and serving large models in a fully decentralized way on small consumer-grade devices connected via the internet. Despite being dismissed as infeasible, we have made significant advances on this problem, most recently Agora, a permissionless run that pretrained an 8B model from scratch on consumer GPUs spread over the internet, with no single participant ever holding the full weights (tech report). While many of the core research problems have been solved, Protocol Learning unlocks a series of new challenges. For the mission in full, read A Third Path: Protocol Learning.

Agora gave us a pretrained 8B model. Post-training is how we make it useful for agentic use-cases. But every post-training stack you've seen assumes a datacenter — synchronous rollouts, fast interconnects, trusted workers. Ours gets none of that. It has to run on consumer GPUs, and Macs spread across the public internet, training a model whose weights no single participant ever holds, with rollouts arriving from a geo-distributed inference pipeline at high latencies. Your primary role is to make RL post-training work here anyway — the algorithms and the system, end-to-end.

K

Similar Openings in Other

View all in category