Machine Learning Systems Engineer - Data & Evaluation, Horizons

Job Description

Anthropic is seeking a Machine Learning Systems Engineer to join its Horizons team. This role focuses on building software infrastructure to enable AI models to use tools effectively and measure their performance. The engineer will contribute to advancing AI systems by developing and extending the agent framework, creating and implementing evaluations, managing training data pipelines, and applying data science techniques.

The Machine Learning Systems Engineer will collaborate with researchers to translate evaluation needs into scalable, production-grade systems. Anthropic values impact and collaboration, offering a flexible working environment and a commitment to building beneficial AI systems.

Role Involves:

• Extending and improving the agent framework.
• Designing and implementing evaluation systems.
• Building and maintaining data pipelines for RL training data.
• Developing dashboards and analysis tools.

Requirements:

• Proficiency in Python and data analysis libraries (Pandas, NumPy, etc.).
• Experience creating data visualizations and interactive dashboards.
• Strong software engineering fundamentals with clean APIs.
• Ability to communicate technical concepts clearly.
• Experience with web development for interactive tools (JavaScript, React, etc.).
• Passion for measuring and improving AI capabilities and safety.
• Bachelor's degree in a related field or equivalent experience.

What Anthropic Offers:

• Competitive compensation and benefits.
• Optional equity donation matching.
• Generous vacation and parental leave.
• Flexible working hours.