Pluralis Research logo
Posted 2w agoAustralia

Research Engineer Intern

InternAustraliaSalary undisclosed
Required Skills
PythonNode.jsAWSGCPPyTorch
Job Description

Pluralis Research works on Protocol Learning: training and serving large models in a fully decentralized way on small consumer-grade devices connected via the internet. Despite being dismissed as infeasible, we have made significant advances on this problem, most recently Agora, a permissionless run that pretrained an 8B model from scratch on consumer GPUs spread over the internet, with no single participant ever holding the full weights (tech report). While many of the core research problems have been solved, Protocol Learning unlocks a series of new challenges. For the mission in full, read A Third Path: Protocol Learning.

As a Research Engineer Intern you'll work on Agora, our production decentralized training system, alongside the engineers running real multi-node training at scale. Intern projects are well-scoped pieces of our live roadmap, not side experiments: you'll ship real work in week one and own a genuine open problem by the end of your internship.

Key Responsibilities

  • Ship a roadmap project: Design, build, and ship a well-scoped project on the Agora roadmap, with a final presentation to the engineerin

Similar Openings in Other

View all in category