Software Engineer, Inference Scalability and Capability

Job Description

Anthropic is seeking a Software Engineer to join their Scalability and Capability Inference team. This team is responsible for building and maintaining the systems that serve Anthropic's LLMs. The engineer will focus on scaling inference systems, ensuring reliability, optimizing compute resource efficiency, and developing new inference capabilities. Anthropic values impact and collaboration, offering competitive compensation and benefits.

The role involves:

• Optimizing inference request routing.
• Autoscaling compute fleet.
• Contributing to new inference features.
• Supporting inference for new model architectures.
• Ensuring smooth deployment of inference services.
• Analyzing observability data to tune performance.

Requirements:

• Significant software engineering experience.
• Results-oriented with a bias towards flexibility and impact.
• Experience with high-performance, large-scale distributed systems (preferred).
• Experience implementing and deploying machine learning systems at scale (preferred).
• Bachelor's degree in a related field or equivalent experience.

Anthropic offers:

• Competitive compensation and benefits.
• Optional equity donation matching.
• Generous vacation and parental leave.
• Flexible working hours.