About the Role
CNTXT AI is seeking a detail-oriented Arabic/English Bilingual AI Data Annotator & Evaluator for a remote, hourly contractor position. This project-based role offers flexible hours and involves contributing to advanced AI data and language projects. The position requires leveraging senior-level Arabic localization and translation expertise, alongside strong English proficiency, to ensure the accuracy, quality, and cultural relevance of AI training datasets and outputs.
CNTXT AI focuses on building accurate, safe, and globally relevant AI products and data solutions, with a specialization in Arabic-native and secure, sovereign solutions. This role provides an opportunity to engage with a company at the forefront of AI innovation.
Key Responsibilities
- Labeling, classifying, and structuring documents, tables, and other content to support AI training dataset development.
- Evaluating AI-generated responses for accuracy, reasoning quality, coherence, and cultural/linguistic appropriateness.
- Generating high-quality prompts and model responses to guide AI learning across various topics.
- Performing localization quality assurance to ensure terminology, tone, cultural nuance, and locale-specific details (such as units, references, names, and dates) are consistently accurate in AI outputs.
- Applying senior-level Arabic localization and translation judgment to ensure consistent accuracy in terminology, tone, and cultural nuance across different use cases.
Qualifications and Requirements
- Bachelor's degree or higher in Translation, Linguistics, Localization, Communications, or a related field.
- Native or near-native Arabic proficiency with strong writing and editing skills in Modern Standard Arabic and at least one dialect.
- Minimum C1 English proficiency (reading and writing) for interpreting prompts, source materials, and evaluation guidelines.
- Excellent editorial judgment regarding register, tone, punctuation, inclusivity, and cultural nuance, with a high level of attention to detail.
- Ability to identify meaning drift, ambiguity, locale inconsistencies, and subtle errors, and to articulate corrections clearly in writing.
- Capacity to rigorously fact-check localized content, including units, references, names, and dates, using reliable sources and consistent reasoning.
- Skill in identifying reasoning gaps, methodological errors, and unclear explanations, even in fluent language.
- Must be reliable, self-directed, and capable of delivering consistent quality with clear communication and responsiveness across different time zones.
Required Skills
- Arabic Localization
- Translation
- English Proficiency (C1 level reading/writing)
- Editorial Judgment
- Attention to Detail
- Fact-Checking
- Problem-Solving
- Self-Direction
- Communication
- Responsiveness
- Localization QA
- MQM/LQA Concepts
- CAT Tools
- QA Workflows
- AI Data Training
- AI Annotation
- AI Evaluation
Work Arrangement Details
This is an hourly contractor role. The work is project-based, offering flexible hours. The role is remote. While the advertisement mentions Riyadh, Saudi Arabia as a location, the position is remote.
