Job Description
Perplexity is looking for an AI Training Infrastructure Engineer to enhance their in-house Online LLMs, the Sonar models. The ideal candidate will collaborate with the team to develop a robust training framework, particularly for post-training LLMs. This role involves building and maintaining the infrastructure necessary to support cutting-edge model training at scale.
Responsibilities:
- Build a post training framework that can run cutting-edge model training jobs in scale
- Implement the necessary infra and components to support latest models and algorithms like SFT, RL (DPO/GRPO) and more
- Own the full stack data, training, and eval pipelines required to post-train LLM models
- Work closing with engineering teams to integrate Sonar models into our product.
Requirements:
- Proven experience with large-scale LLMs frameworks building
- Strong in Python/Pytorch; C++/CUDA is a plus
- Self-starter with a willingness to take ownership of tasks
- Passion for tackling challenging problems
- Minimum of 6 years of working on relevant projects.
Perplexity offers:
- Equity
- Comprehensive health, dental, and vision insurance
- 401(k) plan