QA Specialist Audio Annotation & Diarization (Arabic)📣 Job Ad

About the Role

Turing is seeking a QA Specialist for Audio Annotation & Diarization to contribute to building a highly accurate, evaluation-grade dataset of transcribed, multi-channel audio recordings. This project focuses on assessing multilingual, multi-speaker AI systems through the evaluation of realistic conversations representing diverse dynamics, contexts, and demographics. This is a contract position based in Saudi Arabia.

Project Workflow

Contributors will record unscripted group conversations. These recordings undergo an initial transcription and diarization process, which is then human-validated and corrected. As a QA Specialist, you will serve as the final quality control, responsible for reviewing the end-to-end quality of both the audio recordings and the human-verified annotations.

Key Responsibilities

• Evaluate multi-channel audio recordings to ensure they meet strict technical and fidelity requirements, verifying channel isolation and the absence of disruptive background noise, clipping, or low gain.
• Review human-validated transcriptions to ensure exceptionally high accuracy and adherence to strict low error-rate (WER) targets, confirming that transcripts correctly capture spontaneous, unnormalized speech, including overlaps, interruptions, and false starts.
• Validate the precision of turn-level and word-level timestamps, as well as speaker identification, with particular attention to complex, overlapping dialogue, and ensure accurate metadata tagging and timestamp logic within JSON-formatted data.
• Verify the accuracy of all applied metadata, including demographic markers, contextual domains, and specific conversational tags.
• Enforce strict safety and privacy standards by auditing sessions to ensure no Personally Identifying Information (PII), toxic, or sensitive content is present.
• Assess the end-to-end quality of the annotation task, assigning clear pass/fail or agree/disagree statuses.
• Provide detailed, actionable comments and feedback when disagreeing with an annotator's work.

Required Qualifications

• Exceptional ear for audio fidelity and the ability to detect subtle background noises, channel bleed, or clipping.
• Meticulous attention to detail for verifying word-level timestamps and strict, unnormalized verbatim transcription rules.
• Native proficiency in Arabic.
• Ability to accurately assess complex multi-speaker dynamics.

Ideal Backgrounds

Ideal candidates may have backgrounds in the following areas:

• Linguists/Phonetics Experts: Possessing a deep understanding of natural, unnormalized speech patterns and expertise in accurately identifying and annotating complex conversational dynamics.
• Language Teachers: Demonstrating exceptional, native-level mastery of the target language and the ability to strictly adhere to verbatim transcription guidelines, documenting all speech elements without prescriptive grammar corrections.
• Professional Transcriptionists: Exhibiting a keen ear for audio fidelity, rigorous timestamping skills, and experience meeting strict accuracy targets, with a precise approach to turn-level and word-level timestamping.

Contract Details

This is a contract assignment for a duration of 4 weeks. The engagement is as a contractor/freelancer, and does not include medical benefits or paid leave. Shortlisted candidates will be contacted for onboarding.