Browse All Jobs

SEAL Research Scientist, Scalable Oversight

Research Scientist for Scalable Oversight, safety and transperancy for AI.
Scale AI
On-Site
United States
USD 176,000 - 300,000
Job Description
Scale is seeking a Research Scientist for its Safety, Evaluations and Alignment Lab (SEAL). In this role, the candidate will contribute to the research and development of methods to evaluate and supervise advanced AI systems. This involves designing experiments, developing supervision protocols, gathering human annotations, and training language models. The work involves collaboration across the industry and academia, with the aim of shaping the landscape for AI safety and transparency.

Role Involves:
  • Designing experiments to exemplify failure modes of current supervision protocols for language models
  • Designing experiments to simulate expertise and capability gaps between supervisor and model for scalable oversight experiments
  • Developing new supervision protocols and gather human annotations using these protocols
  • Training language models using reinforcement learning, analyzing their behavior and comparing between models

Requirements:
  • Commitment to promoting safe, secure, and trustworthy AI deployments.
  • Experience conducting technical research collaboratively, with proficiency in frameworks like Pytorch, Jax, or Tensorflow.
  • A track record of published research in machine learning, particularly in generative AI.
  • At least three years of experience addressing sophisticated ML problems.
  • Strong written and verbal communication skills.

Company Offers:
  • Comprehensive health, dental and vision coverage
  • Retirement benefits
  • A learning and development stipend
  • Generous PTO
Apply Manually

Scale AI

Scale AI accelerates the development of AI applications across industries. The company's products power advanced language models, generative models, and computer vision models. Scale AI serves generative AI companies, government agencies, and enterprises, assisting organizations in building and deploying AI. Committed to inclusivity and equal opportunity, Scale AI fosters professional growth, offering opportunities to contribute to cutting-edge AI projects and collaborate with experts in the field.

All Jobs at Scale AI (200)