img
نوع العقددوام كامل
طبيعة الوظيفةعن بُعد
الموقعالرياض

وصف الوظيفة

About the Role

YO IT Consulting is seeking a Psychology Quality Assurance Lead for a remote, hourly contract position. This role is crucial for overseeing the quality, consistency, and performance of trainers involved in psychology-focused AI training projects. The position requires a professional to review AI-generated psychology content and the work of trainers and QA personnel, ensuring adherence to project guidelines and quality standards.

Role Context and Impact

The Psychology Quality Assurance Lead will play a direct role in enhancing leading AI models by ensuring that psychology training data is accurate, ethical, appropriately cautious, research-informed, and aligned with client expectations. This position is not tied to an immediate project but will position qualified candidates to be among the first contacted for relevant future opportunities and gain access to the company's expert network.

Key Responsibilities

  • Assess content for psychological accuracy, theory application, research literacy, ethical awareness, mental-health safety, diagnostic caution, clarity, formatting, and adherence to project rubrics.
  • Identify recurring quality issues and communicate updates to trainers and QA personnel.
  • Support the onboarding process and maintain project documentation.
  • Assist in activating contributors who are not working consistently.
  • Conduct quality monitoring through spot-checks of psychology items and provide ongoing feedback.
  • Evaluate AI-generated psychology explanations, mental-health content, research summaries, behavioral guidance, theory applications, and safety-sensitive responses.
  • Communicate project changes, workflow updates, and quality expectations to trainers and QA teams, particularly on platforms like Discord.
  • Respond to trainer and QA questions regarding psychological concepts, evidence quality, ethical boundaries, and rubric interpretation.
  • Manage trainer and QA activation by encouraging engagement and tracking follow-ups.
  • Create and maintain project documentation, including style guides, trackers, FAQs, and onboarding materials.
  • Conduct onboarding and training sessions to explain project expectations and quality standards.
  • Ensure consistent application of psychology review guidelines among all team members.
  • Flag content that is unsafe, overconfident, stigmatizing, pseudoscientific, diagnostically inappropriate, or crisis-insensitive.
  • Propose workflow improvements and contribute to building scalable QA processes.

Qualifications and Experience

  • Bachelor's, Master's, PhD, PsyD, or equivalent professional background in Psychology, Clinical Psychology, Counseling, Behavioral Science, Cognitive Science, Neuroscience, Social Work, Psychiatry-adjacent research, Education, or a related field.
  • A strong command of the English language for communication and feedback.
  • A minimum of 3 years of experience in psychology research, clinical/counseling settings, behavioral science, teaching, academic writing, mental-health content review, or psychological assessment.
  • A solid understanding of psychological theories, research methods, cognitive and social psychology, developmental psychology, abnormal psychology, ethics, evidence-based practice, and mental-health safety.
  • The ability to evaluate psychology content against detailed rubrics and identify specific issues.
  • Familiarity with areas such as CBT, developmental psychology, personality, trauma-informed communication, behavioral interventions, mental-health literacy, research design, statistics, and ethical guidelines is preferred.
  • Experience leading or supporting remote teams of researchers, clinicians, educators, reviewers, annotators, or QAs is strongly preferred.
  • Experience with AI training, data annotation, LLM evaluation, psychology QA, mental-health content review, or rubric-based review is a strong plus.

Required Skills and Competencies

  • Exceptional attention to detail and organizational skills.
  • Proficiency in working with remote collaboration tools such as Discord, Google Sheets, Google Docs, trackers, dashboards, and project management systems.
  • Ability to provide precise written feedback.
  • Strong analytical skills for evaluating content against complex guidelines.
  • Effective communication and interpersonal skills for team collaboration and feedback delivery.

Work Arrangement

This is a remote, contract position. The selection process includes an AI interview, a domain-specific task, and an interview with a recruiter.


متطلبات الوظيفة

  • تتطلب ٥-١٠ سنوات خبرة

وظائف مشابهة