GenAI Multilingual Specialist LLM/VLM Evaluation & SFT Expert📣 Job Ad

About the Role

TELUS Digital AI Data Solutions is seeking a GenAI Multilingual Specialist — LLM/VLM Evaluation & SFT Expert to join our team in Riyadh, Saudi Arabia. This part-time role, requiring 0-1 years of experience, involves supporting the development and evaluation of next-generation Large Language Models (LLMs) and Vision-Language Models (VLMs). The specialist will serve as the human reasoning layer for AI systems, evaluating multilingual AI-generated content for accuracy, consistency, instruction adherence, and cultural relevance. Workflows include Supervised Fine-Tuning (SFT), rubric-based scoring, fact verification, and multimodal (image + text) evaluation.

Key Responsibilities

• Review AI-generated responses to assess quality, reasoning accuracy, factual correctness, and compliance with project guidelines.
• Create and evaluate multilingual Supervised Fine-Tuning (SFT) data to enhance AI model performance across various languages and domains.
• Perform Multimodal (VLM) Assessment by analyzing relationships between images and text outputs to evaluate contextual accuracy and multimodal reasoning quality.
• Apply Rubric-Based Scoring to assess outputs using structured scoring frameworks and standardized evaluation rubrics.
• Conduct Research & Fact Verification, verifying claims using authoritative sources and applying citation standards to distinguish factual information from unsupported assertions.
• Escalate Edge Cases, identifying ambiguous outputs, policy concerns, and reasoning inconsistencies that require additional review.
• Maintain Operational Accuracy by consistently following complex project SOPs and quality standards across high-volume evaluation workflows.

Required Qualifications

• Experience: 0-1 years of relevant experience.
• Language Expertise: Native or fluent-level proficiency in Gulf Arabic language with strong reading and writing ability.
• Analytical Thinking: Ability to evaluate content objectively and identify inconsistencies, logical gaps, or quality issues.
• Attention to Detail: Strong procedural discipline and the ability to follow detailed project guidelines accurately.
• Communication & Reliability: Strong communication skills with the ability to work independently in remote environments.
• Research & Verification Skills: Comfortable conducting fact-checking and validating information using credible and authoritative sources.

Preferred Skills and Backgrounds

• Technical Familiarity: Previous experience in freelance work, translation, writing, annotation, AI data projects, localization, or content evaluation is an advantage.
• AI/ML Experience: Prior experience with AI/ML annotation, LLM evaluation, or SFT projects is strongly preferred.
• Specialized Knowledge: Candidates with academic or professional backgrounds in Computer Science, Biology, Law, Finance, Physics, Mathematics, or Engineering are highly valued.

The TELUS Digital AI Community and Engagement

The TELUS Digital AI Community is a global network of over one million contributors who support the collection, enhancement, training, translation, and localization of content for AI model development. Contributors work remotely and can manage their own schedules, contributing to the development of AI technologies used by major brands. This opportunity is offered on an independent contractor basis, providing flexibility in work hours and volume, subject to project availability and quality requirements. This engagement does not constitute an employment relationship with TELUS Digital.

Application Process

Candidates will undergo a subject-specific qualification exam to determine suitability for the position. Successful completion of this exam, along with ID verification, is required for engagement within the community.