Data Quality & AI Operations Manager

About Extend

Extend is a Saudi cultural intelligence and advertising company established in 2012. The company serves leading brands and institutions across the Kingdom in experiences, media, and publishing. Extend is currently developing Extend CIP, a Cultural Intelligence Platform designed to plan, manage, and measure all media activity, both earned and paid, with cultural intelligence and AI at its core. This platform encompasses media and influencer buying, alongside a brand monitoring suite.

The Role

Extend is seeking a Data Quality & AI Operations Manager to oversee content and data operations for the Extend platform. This full-time role, based in Riyadh, involves building and maintaining accurate profiling processes, leveraging AI fine-tuning to automate manual annotation, and leading the content operations team. The manager will be responsible for the evaluation and data feedback loop, with success measured by golden-set accuracy and profile automation rate. The position requires 2-5 years of relevant experience.

Key Responsibilities

• Build and maintain golden sets and evaluation suites, defining acceptance criteria for each AI Admin iteration.
• Manage the data aspects of AI Admin iterations, including curating training and evaluation data, running benchmarks, analyzing failure modes, and collaborating with Shanghai engineering on fine-tuning and deployment.
• Design the human-in-the-loop (HITL) mechanism, establishing the boundary between human review and auto-approval, and integrating human corrections into prompts, evaluation sets, and training data.
• Author and maintain Arabic/English labeling guidelines, adjudicating edge cases that require cultural and linguistic judgment.
• Lead the content operations team, ensuring end-to-end ownership of annotation operations, including rater training, workflows, throughput, and quality SLAs.
• Establish and track a quality metrics framework, covering accuracy, automation rate, inter-annotator agreement, cost, and turnaround per profile.

Qualifications and Experience

• A minimum of 2-5 years of relevant professional experience.
• Demonstrated ability to manage data operations and AI fine-tuning processes.
• Experience in leading teams and managing quality metrics.
• Proficiency in both Arabic and English for guideline authoring and cultural/linguistic judgment.

Work Environment

This is a full-time position based in Riyadh. The role involves working within a dynamic environment focused on cultural intelligence and advertising, with a strong emphasis on AI-driven solutions.

Application Process

Candidates interested in this role are encouraged to apply. Further details regarding the application process will be provided upon initial contact.