Machine Learning Systems Engineer, Model APIs

Job Description

Anthropic is seeking a Machine Learning Systems Engineer to join their Model APIs team. This individual will be responsible for building scalable systems that enable researchers to effectively evaluate models and conduct inference tasks. The role involves collaborating with researchers to understand their needs and build infrastructure that makes their workflows more efficient and reproducible. The work will directly impact Anthropic's ability to advance the frontiers of AI in a safe and responsible manner.Responsibilities include:

• Designing, building, and maintaining Model Evaluations infrastructure.
• Developing and optimizing APIs and infrastructure for Research Inference.
• Creating scalable data pipelines for collecting, processing, and analyzing research outputs.
• Implementing monitoring, logging, and performance optimization for research-focused inference systems.
• Building intuitive interfaces and tools for researchers.
• Collaborating with research teams to understand their evolving needs.
• Improving system performance, reliability, and scalability.
• Participating in on-call rotation and documenting systems thoroughly.

The ideal candidate will have:

• 3+ years of software engineering experience.
• Experience with data infrastructure and processing large datasets.
• Proficiency in Python and experience with cloud infrastructure (AWS, GCP).
• Excellent communication skills and the ability to collaborate effectively.
• A commitment to developing AI responsibly.

Anthropic offers:

• Competitive compensation and benefits.
• Optional equity donation matching.
• Generous vacation and parental leave.
• Flexible working hours.