Senior Manager Data Quality & Evaluation📣 Job Ad

About the Role

Jobgether is seeking a Senior Manager Data Quality & Evaluation for a full-time position. This role is central to establishing and leading the quality foundation for advanced AI data programs, supporting the development of next-generation intelligent systems. The position requires defining evaluation frameworks, quality standards, and operational processes to ensure reliable and scalable human data workflows.

Role Purpose and Impact

This role combines strategic leadership, analytical problem-solving, and hands-on execution across AI evaluation, annotation, and data quality initiatives. The Senior Manager will collaborate with cross-functional teams and customers to transform complex requirements into effective quality solutions. A key objective is to strengthen trust, performance, and scalability across AI development programs. The ideal candidate is a quality-focused leader who excels at building systems, improving processes, and driving operational excellence within a fast-moving AI environment.

Key Responsibilities

• Design and manage quality frameworks for AI data and evaluation programs, including standards, acceptance criteria, review processes, and performance metrics.
• Translate customer requirements into scalable quality workflows for data collection, annotation, evaluation, review, calibration, and reporting.
• Identify quality risks proactively and collaborate with delivery teams to resolve issues affecting timelines, customer confidence, or program outcomes.
• Build repeatable quality processes for calibration, QA sampling, adjudication, reviewer performance tracking, and customer reporting.
• Lead quality operations across multilingual evaluation, speech and audio review, transcription, annotation, human preference evaluation, expert review, coding evaluation, and AI model assessment programs.
• Develop and improve rubrics, task instructions, reviewer guidelines, calibration exercises, golden datasets, scorecards, and reporting templates.
• Monitor quality indicators such as reviewer agreement, error trends, performance metrics, and root causes of quality variation.
• Turn quality insights into actionable improvements across instructions, training programs, tooling, staffing models, and operational workflows.
• Support strategic customer programs through quality reviews, business discussions, escalations, retrospectives, and improvement plans.
• Partner with internal teams to ensure programs are designed for quality success from initial planning through production delivery.
• Build reusable quality assets and standardized approaches to improve scalability across multiple programs.
• Lead, coach, and develop Quality Managers, Quality Leads, Quality Specialists, reviewers, and other contributors involved in data quality operations.
• Promote a culture of quality ownership, accountability, continuous improvement, and operational excellence.

Experience and Qualifications

Candidates for this position should possess 5-10 years of relevant experience in data quality, AI evaluation, or related fields. The role requires a leader with demonstrated experience in building and improving quality systems and processes within an AI-driven environment.

Work Environment

This full-time role operates within a dynamic and fast-moving AI development environment. It involves extensive collaboration with diverse cross-functional teams and external customers to achieve program objectives.

Application Information

Jobgether invites qualified professionals to apply for this Senior Manager Data Quality & Evaluation position.