Research Engineer - Language Model Pre-Training

Zyphra is an artificial intelligence company based in San Francisco, California.

The Role:

As a Research Engineer - Language Model Pre-Training, you'll shape our language model roadmap through end-to-end pretraining development. You will work extremely closely with our pretraining team, who will integrate your insights into our next-generation models.

You'll Work Across:

• Large-scale training runs and model parallelization

• Performance optimization of our pretraining stack

• Dataset collection, processing, and evaluation

• Architecture and methodology research, including optimizer ablations

What We're Looking For / Requirements:

• Strong engineering aptitude for rapidly implementing reliable and robust systems

• Can rapidly learn new fields and are excited to implement new ideas

• Excellent communication and collaboration skills, and can work effectively on both research and engineering implementation at scale