Staff Software Engineer, Cloud Inference

Job Description

Anthropic is seeking a Staff Software Engineer to join its Cloud Inference team. This role involves architecting, building, and scaling Anthropic's cloud offerings to make large language models available to customers across multiple platforms. The engineer will address complex distributed systems challenges, focusing on safety, security, efficiency, and reliability. They will collaborate with major cloud partners to enable frontier AI capabilities and integrate these capabilities into customer applications.

Responsibilities include:

• Scaling model serving infrastructure to meet growing demand.
• Optimizing accelerator utilization to efficiently allocate resources.
• Collaborating with major cloud platforms to implement and optimize AI capabilities.
• Building and operationalizing infrastructure to package, test, and deploy inference technology.
• Implementing trust and safety measures into APIs and infrastructure.
• Contributing innovative ideas to build better AI systems.

Requirements include:

• Strong practical coding skills (including Python) and experience with complex distributed systems.
• Adept at designing highly observable code and systems that operate reliably at scale.
• Customer-focused approach to building infrastructure, backend systems, and customer-facing APIs.
• Comfort working in a fast-paced environment and adapting to evolving priorities.
• Excellent written and verbal communication skills.
• Bachelor's degree in a related field or equivalent experience.

The role offers:

• Competitive compensation and benefits.
• Optional equity donation matching.
• Generous vacation and parental leave.
• Flexible working hours.