AI Training in ARABIC📣 Job Ad

About the Role

Gramian Consulting, a consulting firm specializing in IT services and engineering talent solutions, announces its need for Arabic-speaking "AI Content Analysts" on behalf of one of its clients. This role plays a crucial part in supporting the evaluation of a new personalization capability within a leading AI assistant platform. This position offers a unique opportunity that combines creative prompt design, analytical evaluation, and structured quality assessment, making it a suitable opportunity for individuals with a background in AI evaluation, annotation, content review, or analytical research.

Nature of Work and Responsibilities

In this contract role, you will be instrumental in shaping the user experience of an AI assistant by designing realistic conversational prompts based on your own context and experiences. You will then meticulously evaluate how effectively the AI uses personal signals, such as past conversations or activity context, to generate relevant and factually grounded, helpful responses. Gramian Consulting is committed to a clear and straightforward hiring process for all candidates.

Key Tasks

• Design and implement short, multi-turn conversations (typically 1-5 turns) specifically aimed at testing the AI's personalization behavior.
• Create prompts based on realistic personal scenarios to effectively evaluate the AI's contextual understanding.
• Review AI-generated responses to determine if personalization has been applied correctly.
• Assess the quality of the AI's response grounding to ensure the model is not fabricating unsupported claims about the user.
• Evaluate the quality of personal signal integration, ensuring they are used naturally and not in a forced or robotic manner.
• Compare two AI-generated responses side-by-side and identify which is more helpful, natural, and relevant.
• Write clear and structured justifications to explain classifications and reference specific conversation turns.
• Verify correction information to confirm that the correct data sources have been utilized by the AI.
• Strictly maintain workflow cleanliness, including timely deletion of evaluation conversations as needed.

Qualifications and Requirements

• Strong proficiency in Arabic, both reading and writing, as Arabic is the primary evaluation language for this role.
• Bachelor of Science (BS) or Bachelor of Arts (BA) degree or equivalent experience in a relevant field such as Politics, Law, Ethics, Linguistics, Journalism, Computer Science, or any other relevant analytical field.
• Proven strong analytical thinking skills and the ability to evaluate AI outputs critically.
• Excellent written communication skills, with the ability to produce clear and organized evaluation notes.
• High attention to detail, especially when comparing similar AI responses.
• Ability to work independently and effectively in a fully remote work environment.
• Access to a reliable desktop or laptop computer and a stable internet connection.
• Willingness to use your primary personal Google account and enable personal data sources for evaluation purposes.

Required Skills

• AI Evaluation
• Annotation
• Content Review
• Analytical Research
• Analytical Thinking
• Written Communication
• Attention to Detail
• Ability to Work Independently

Additional Job Information

This role is a contract for two months or more, requiring a commitment of 30-40 hours per week. Payment will be based on logged and approved hours. The position is 100% remote, with a preference for candidates located in Egypt, Ghana, Nigeria, and Saudi Arabia.