AI Engineer & Researcher - Post-training

Job Description

xAI is seeking an AI Engineer & Researcher to join their post-training team. The ideal candidate will transform powerful pre-trained models to become steerable and versatile. They should want to aid humanity in its pursuit of knowledge and develop AI systems that can accurately understand the universe.

The role involves enhancing the model's instruction-following capability and general usefulness. The engineer will collaborate with pre-training, reasoning, data, multimodal, applied, and product teams.

Responsibilities:

• Creating and driving research agenda to advance model quality.
• Improving data mixtures by building data collection pipelines and developing data generation techniques.
• Creating generalizable reward models and developing novel reinforcement learning algorithms.
• Designing and implementing robust model evaluations.
• Designing and implementing large-scale model training frameworks.
• Collaborating with pre-training, reasoning, data, multimodal, applied, product efforts to push the frontiers of model capability.

Requirements:

• Expert in ML and fine-tuning large language models.
• Track record in leading research that significantly impacts AI advancement.
• Experience in data-driven large language model behavior improvements.
• Experience in advanced reinforcement learning or inference-time search techniques.
• Experience in developing benchmarks or large-scale distributed machine learning systems.
• Experience in model optimizations under complex setups.
• Proficiency in Python, Jax, and Rust.

Benefits:

• Opportunity to work on cutting-edge AI systems.
• Collaborative environment with a small, highly motivated team.