AI Engineer & Researcher - Pre-training Scaling, Data, and Eval

Job Description

xAI, whose mission is to create AI systems that can accurately understand the universe and aid humanity, is looking for an AI Engineer & Researcher. The ideal candidate will focus on training trillion parameter neural networks at scale, rapidly implementing state-of-the-art methods, and innovating new ideas for pretraining and scaling. xAI operates with a flat organizational structure, expecting all employees to be hands-on and contribute directly to the company’s mission.

Responsibilities include:

• Training large-scale neural networks.
• Implementing state-of-the-art deep learning methods.
• Innovating new pretraining and scaling paradigms.
• Improving pretraining data quality at scale across different modalities.

Requirements:

• Strong engineering skills with a passion for improving data and model aspects.
• Expertise in ML and large model scaling.
• Familiarity with distributed training and multi-GPU neural network training.
• Experience in optimizing ML training efficiency.
• Familiarity with state-of-the-art techniques for preparing AI training data.
• Proficiency in organizing and managing data across multiple clouds and modalities.

xAI offers:

• Opportunity to work on challenging AI systems.
• A collaborative environment with a flat organizational structure.
• A focus on engineering excellence and curiosity.