Skip to main content
All jobs

Employer listing

Quality Operations Lead, Gen AI

Scale AI

San Francisco, Ca · on site · full time · Lead

$134,400 - $168,000

About the Role

The quality of data underpins Generative AI programs. At Scale, Quality Control is responsible for ensuring data we deliver to the world’s leading AI customers is state of the art.

As a Quality Operations Lead, you’ll own that call for some of our highest-impact Generative AI programs. You'll lead a large team of quality control specialists to measure and improve quality across these programs, from multilingual post-training data to agentic RL environments. You will work on frontier-level problems – the programs you work on train the models people are talking about.

You will hold delivery teams accountable across our highest-impact projects – helping solve nuanced quality issues, as well as leading strategic initiatives to enable reliable, scalable operations across the organization.

Responsibilities

  • Lead and grow a team of quality specialists: Hire, coach, and calibrate this team of specialists.
  • Turn unclear customer requirements into clear standards: Work with delivery teams to interpret and improve customer requirements, and turn that into measurable signals of data quality.
  • Run the quality system: Own the daily operation: plan and allocate workforce capacity, produce quality reporting, measure productivity and efficiency, and drive quality control policies.
  • Analyzing quality trends: Identify, root-cause, and elevate defect patterns that delivery teams can take action on.
  • Build the future of QC: Leverage agentic capabilities and help decide and lead what gets built next to scale and optimize quality operations.

Qualifications

Ideally You'd Have

  • A Bachelor’s degree in Computer Science, Engineering, Operations, or a related field.
  • 3+ years leading teams or scaling large operational/technical processes.
  • Strong analytical and problem-solving skills (particularly in SQL) with attention to detail.
  • Experience building systems, processes, and teams across multiple customer segments or product lines.
  • A hands-on background in product management, operations management, program management, or top-tier management consulting.
  • Proven experience taking initiative in cross-functional technical environments.

Nice to Haves

  • Master’s degree in Computer Science, Engineering, Operations, or a related field.
  • Experience in AI/ML services, data annotation, or model evaluation.
  • Experience in a fast-growing, less-structured startup environment.
  • Experience building teams from the ground up.

Application Notes

  • Our policy requires a 90-day waiting period before reconsidering candidates for the same role.

Benefits

Comprehensive health, dental, and vision coverage, retirement benefits, learning and development stipend, generous PTO, equity grant eligibility, and potential commuter stipend.