QA Specialist Audio Annotation & Diarization (Arabic)📣 Job Ad

About Turing and the Project Context

Turing, headquartered in San Francisco, California, operates as a leading research accelerator for frontier AI laboratories and a trusted partner for global enterprises deploying advanced AI systems. The company supports customers by advancing frontier research with high-quality data, sophisticated training pipelines, and top AI researchers, applying this expertise to transform AI concepts into proprietary intelligence.

Currently, Turing is developing an evaluation-grade dataset of transcribed, multi-channel audio recordings. This dataset is crucial for assessing multilingual and multi-speaker AI systems, focusing on high-quality, realistic conversations that represent diverse dynamics, contexts, and demographics.

The Role: QA Specialist, Audio Annotation & Diarization (Arabic)

Turing is seeking a QA Specialist, Audio Annotation & Diarization (Arabic) to join the team in Saudi Arabia. This contract role, suitable for candidates with 0-1 years of experience, serves as the final quality assurance step in the data generation workflow. The specialist will be responsible for reviewing the end-to-end quality of both audio recordings and human-verified annotations, ensuring the dataset meets stringent evaluation standards.

Key Responsibilities

• Evaluate multi-channel audio recordings to ensure adherence to strict technical and fidelity requirements.
• Verify channel isolation and confirm recordings were captured in appropriate, quiet environments free from disruptive background noise, clipping, or low gain.
• Review human-validated transcriptions for exceptionally high accuracy and compliance with strict low error-rate (WER) targets.
• Confirm that transcripts accurately capture spontaneous, unnormalized speech, preserving natural conversational dynamics such as overlaps, interruptions, and false starts.
• Validate the precision of turn-level and word-level timestamps, as well as speaker identification, with particular attention to complex, overlapping dialogue.
• Read and validate underlying JSON-formatted data to ensure accurate metadata tagging and timestamp logic.
• Verify the accuracy of all applied metadata, including demographic markers, contextual domains, and specific conversational tags.
• Enforce strict safety and privacy standards by auditing sessions to ensure no Personally Identifying Information (PII), toxic, or sensitive content is present.
• Assess the end-to-end quality of the annotation task, assigning clear pass/fail or agree/disagree statuses during review.
• Provide detailed, actionable comments and feedback when disagreeing with an annotator's work.

Qualifications and Requirements

• Exceptional ear for audio fidelity and the ability to detect subtle background noises, channel bleed, or clipping.
• Meticulous attention to detail for verifying word-level timestamps and strict, unnormalized verbatim transcription rules.
• Native proficiency in Arabic.
• Ability to accurately assess complex multi-speaker dynamics.

Ideal Candidate Profile

Candidates with the following backgrounds are particularly well-suited for this role:

• Linguists/Phonetics Experts: Possessing a deep understanding of natural, unnormalized speech patterns and expertise in accurately identifying and annotating complex conversational dynamics, including overlaps, false starts, and backchannels.
• Language Teachers: Demonstrating exceptional, native-level mastery of the target language and the ability to strictly adhere to verbatim transcription guidelines, documenting every stutter, filler word, and disfluency without applying prescriptive grammar corrections.
• Professional Transcriptionists: Exhibiting a keen ear for audio fidelity, rigorous timestamping skills, and experience meeting strict accuracy targets, with a precise approach to turn-level and word-level timestamping.

Contract Details and Application Process

This is a contractor assignment/freelancer engagement with an initial duration of 4 weeks. Please note that this role does not include medical benefits or paid leave. There is potential for contract extension based on performance and project needs. This role offers the opportunity to contribute to cutting-edge AI projects with leading LLM companies.

Shortlisted candidates will undergo an internal review by our team and will be contacted for onboarding.