Browse All Jobs

LLM Data Researcher

LLM Data Researcher to evaluate data quality and ROI.
Turing
Remote
United States
Undisclosed salary
Job Description
Turing, based in Palo Alto, California, is seeking a strategic and data-savvy LLM Data Researcher. This role focuses on evaluating data quality and its impact on model performance, without directly training models. The ideal candidate will answer foundational questions about data's influence on model performance and benchmark relevance. They will collaborate with various teams to align on quality standards and data priorities, develop data evaluation systems, and drive human-in-the-loop quality processes.

Role involves:
  • Defining and implementing strategies to assess the ROI of data.
  • Building and maintaining benchmarks that measure performance.
  • Collaborating with data operations, research, and delivery teams.
  • Developing systems and tooling for continuous data evaluation.
  • Driving human-in-the-loop quality processes.
  • Identifying data gaps and leading targeted acquisitions or refinements.
  • Defining and/or leveraging comprehensive task taxonomy frameworks.
  • Translating research insights and data evaluations into client-facing value.

Requirements:
  • Strong grasp of LLMs and data-model dynamics.
  • Knowledge of the latest trends in Generative AI.
  • Proven track record in benchmark development, model evaluation, or data-centric infrastructure.
  • Strategic thinker with a bias toward impact.
  • Experience designing and interpreting metrics.
  • Familiarity with annotation workflows, validation processes, and scalable QA systems.
  • Solid ML or data science foundation.

Turing offers:
  • Amazing work culture
  • Awesome colleagues
  • Competitive compensation
  • Flexible working hours
  • Full-time remote opportunity
Apply Manually

Turing

Turing, based in Palo Alto, California, is a rapidly growing AI company focused on advancing and deploying AI systems. It partners with leading AI labs to develop frontier model capabilities in areas like thinking, reasoning, and coding. Turing leverages its AI expertise to build solutions for Fortune 500 companies and government institutions, addressing their mission-critical priorities. The company comprises AI technologists from industry giants and has received accolades for its innovation and as a top startup employer.

All Jobs at Turing (30)