Together AI is seeking a Senior Backend Engineer to contribute to the development and maintenance of Together Cloud's inference and fine-tuning services. The ideal candidate will possess a strong understanding of backend architecture, database design, and high-performance backend services. This role emphasizes writing clear, well-tested code to ensure the API platform's reliability under constant load.He/she will collaborate with the product team to translate product requirements into functional specifications, develop new code, and address bugs in existing code.Responsibilities include:
- Designing core, backend software components
- Performing architecture and research for AI workloads
- Collaborating with other teams to integrate innovations
- Analyzing and improving system resource efficiency, scalability, and stability
- Conducting design and code reviews
- Creating services, tools, and developer documentation
- Developing testing frameworks for robustness and fault-tolerance
- Participating in an on-call rotation
Requirements:
- 5+ years of experience writing high-performance code
- 5+ years of experience with Kubernetes or other orchestration software
- Experience building large-scale, fault-tolerant distributed systems
- Expert-level programmer in Kubernetes
- Excellent understanding of low-level operating systems concepts
- Experience with Pytorch or Tensorflow is a plus
Together AI offers:
- Competitive compensation
- Startup equity
- Other competitive benefits