Arabic/English Bilingual AI Data Annotator & Evaluator ( ly Contractor)📣 Job Ad

About the Role

CNTXT AI is seeking an Arabic/English Bilingual AI Data Annotator & Evaluator for an hourly contractor position. This is a fully remote role supporting AI data and language projects on a flexible, project-based schedule.

Key Responsibilities

• Performing data annotation, which includes labeling, classifying, and structuring various content types to build AI training datasets.
• Evaluating Large Language Model (LLM) outputs for accuracy, reasoning quality, coherence, and cultural/linguistic appropriateness.
• Generating high-quality prompts and model responses to facilitate AI learning across a range of topics.
• Conducting localization quality assurance to ensure consistency in terminology, tone, cultural nuances, and locale-specific details (*, units, references, names, dates) across outputs.

Role Requirements

This role requires applying senior-level Arabic localization and translation judgment, combined with a minimum C1 proficiency in English. You will be responsible for ensuring the accuracy of terminology, tone, and cultural nuance across different applications.

Profile Qualifications

• A Bachelor's degree or higher in Translation, Linguistics, Localization, Communications, or a related field.
• Native or near-native Arabic proficiency with strong writing and editing skills in Modern Standard Arabic and at least one dialect.
• Minimum C1 English proficiency (reading/writing) for understanding prompts, source materials, and evaluation guidelines.
• Excellent editorial judgment regarding register, tone, punctuation, inclusivity, and cultural nuance, with a high level of attention to detail.
• The ability to identify meaning drift, ambiguity, locale inconsistencies, and subtle errors, and to clearly explain corrections in writing.
• Capability to rigorously fact-check localized content using reliable sources and consistent reasoning.
• Proficiency in identifying reasoning gaps, methodological errors, and unclear explanations, even when the language is fluent.
• Must be reliable, self-directed, and capable of delivering consistent quality with clear communication across different time zones.

Preferred Experience

• Professional experience in localization or translation.
• Familiarity with MQM/LQA concepts for consistent quality assessment.
• Proficiency with CAT tools and QA workflows.
• Previous experience with AI data training, annotation, or evaluation.

About CNTXT AI

CNTXT AI develops artificial intelligence products and data solutions focused on making AI accurate, safe, and globally relevant. The company's work includes data services, custom AI solutions, and proprietary AI products, with a specialization in Arabic-native and secure, sovereign solutions.