Machine Learning Engineer, GenAI Quality

Scale is seeking a Machine Learning Engineer to join their Generative AI ML team. This team focuses on developing models and services to enhance data generation and evaluation for large language models. The role involves building scalable systems to assess data quality across various dimensions and designing evaluation frameworks aligned with human standards. The engineer will be involved in the full model lifecycle, from design and fine-tuning to deployment and monitoring, collaborating with engineering, research, and product teams.

Role involves:
• Designing, fine-tuning, and evaluating large language models
• Developing robust evaluation frameworks
• Building and maintaining scalable ML services
• Researching and applying state-of-the-art techniques in LLM training
• Collaborating with cross-functional teams

Requirements:
• 3+ years of experience in designing, training, and deploying ML models
• Strong background in NLP, LLMs, and deep learning frameworks
• Experience building microservices and deploying ML pipelines in cloud environments
• Practical knowledge of LLM fine-tuning and evaluation
• Strong programming skills (e.g., Python)
• Strong communication skills

Role offers:
• Comprehensive health, dental and vision coverage
• Retirement benefits
• Learning and development stipend
• Generous PTO