Technical Program Manager, Inference

Job Description

Anthropic is seeking a Technical Program Manager for Inference to drive critical initiatives connecting AI research to production deployment. The role involves close collaboration with research teams to understand model capabilities and infrastructure teams to deploy models reliably at scale. This position is essential for orchestrating complex model deployments and balancing trade-offs between latency, throughput, and cost.Responsibilities:

• Lead end-to-end program management for model bring-up and deployment.
• Manage complex technical programs involving model optimization and multi-cloud deployment strategies.
• Drive cross-functional initiatives for major launches.
• Track and communicate critical metrics.
• Navigate technical trade-offs between performance, cost, and reliability.
• Coordinate with research teams to understand upcoming model architectures.
• Lead technical discussions around serving strategies.
• Partner with engineering teams to improve inference reliability.
• Create and maintain comprehensive documentation.

Requirements:

• Several years of experience in technical program management.
• Deep technical knowledge to engage with ML researchers and infrastructure engineers.
• Experience with large-scale distributed systems.
• Comfort working with multiple cloud platforms and hardware accelerators.
• Excel at translating between technical teams and stakeholders.
• Experience managing programs with significant external dependencies.
• Ability to thrive in ambiguous situations.
• Strong analytical skills.
• Passion for AI technology.
• Excellent written and verbal communication skills.

Anthropic offers:

• Competitive compensation and benefits.
• Optional equity donation matching.
• Generous vacation and parental leave.
• Flexible working hours.
• A lovely office space.