Neuroscience QA Lead - Remote📣 Job Ad

About the Role

YO IT Consulting is seeking a Neuroscience QA Lead for a remote, full-time contract position. This role is integral to overseeing the quality, consistency, and performance of AI training projects focused on neuroscience and cognitive science. The successful candidate will meticulously review AI-generated content and the work of trainers and QA specialists to ensure adherence to project guidelines and maintain high standards of scientific accuracy and conceptual precision.

This position offers an opportunity to contribute to a growing AI Data Services company that collaborates with leading AI firms and foundation-model labs. The role directly impacts the development of AI models by ensuring the accuracy, evidence-awareness, ethical appropriateness, and clarity of scientific training data. While there is no immediate project assignment, qualified candidates will be considered for relevant future opportunities and gain access to the company's expert network.

Key Responsibilities

• Conduct quality monitoring through spot-checking neuroscience/cognitive science items, identifying quality issues, and providing ongoing feedback to contributors.
• Escalate recurring or critical quality issues to the appropriate stakeholders.
• Perform scientific review of AI-generated neuroscience/cognitive science explanations, research summaries, experimental interpretations, brain-behavior claims, cognitive theory applications, and step-by-step reasoning for accuracy and clarity.
• Communicate updates to trainers and QAs via Discord regarding new item guidelines, project changes, workflow updates, quality expectations, and neuroscience/cognitive-science-specific review standards.
• Respond clearly and promptly to trainer/QA questions, particularly those concerning neural mechanisms, cognition, experimental design, statistical interpretation, ethical boundaries, clinical caution, and rubric interpretation.
• Manage trainer and QA activation by engaging inactive contributors, encouraging participation, tracking follow-ups, and flagging availability issues.
• Create and maintain comprehensive neuroscience/cognitive science project documentation, including style guides, trackers, FAQs, quality notes, examples, honeypots, calibration tasks, and onboarding materials.
• Schedule and conduct onboarding and training sessions for trainers and QAs, detailing project expectations, workflows, rubrics, quality standards, and neuroscience/cognitive-science-specific review requirements.
• Ensure consistent application of neuroscience/cognitive science review guidelines by all trainers and QAs, and communicate updates as projects evolve.
• Conduct safety and ethics reviews, flagging pseudoscientific, overconfident, clinically misleading, ethically problematic, or unsupported claims about the brain, cognition, behavior, or mental health.
• Identify recurring quality gaps, propose workflow improvements, and contribute to building scalable QA processes for neuroscience/cognitive science AI training projects.

Qualifications and Requirements

• Bachelor's, Master's, PhD, MD/PhD, or equivalent professional background in Neuroscience, Cognitive Science, Psychology, Neurobiology, Cognitive Psychology, Computational Neuroscience, Neurology-adjacent research, Biology, Biomedical Sciences, or a closely related field.
• A strong command of the English language is essential for understanding project guidelines, communicating effectively with teams, and providing clear written feedback.
• A minimum of 3 years of experience in neuroscience/cognitive science research, teaching, laboratory work, academic review, science communication, experimental design, data analysis, or related scientific workflows.
• A robust understanding of neural systems, cognition, perception, attention, memory, learning, language, decision-making, neuroanatomy, neural signaling, research methods, and brain-behavior relationships.
• The ability to critically evaluate neuroscience/cognitive science content against detailed rubrics and identify issues such as neuromyths, overclaiming, unsupported causal conclusions, flawed study interpretation, incorrect terminology, pseudoscience, or misleading clinical implications.
• Experience with tools or methods such as EEG, fMRI, behavioral experiments, computational modeling, neuropsychological assessment, statistics, Python/R/MATLAB, cognitive tasks, or literature review is preferred.
• Previous experience leading or supporting remote teams of researchers, reviewers, educators, annotators, science writers, or QAs is strongly preferred.
• Comfort working in fast-moving remote environments utilizing tools such as Discord, Google Sheets, Google Docs, trackers, dashboards, and project management systems.
• Exceptional attention to detail and organizational skills, with the capacity to maintain style guides, FAQs, trackers, onboarding materials, calibration tasks, and documentation.
• Prior experience with AI training, data annotation, LLM evaluation, scientific QA, academic review, psychology/neuroscience content review, or rubric-based review is a strong plus.

Required Skills

• Neuroscience
• Cognitive Science
• Quality Assurance
• Structured Communication
• Attention to Detail
• Scientific Accuracy
• Research Literacy
• Experimental Method Understanding
• Brain-Behavior Reasoning
• Statistical Caution
• Ethical Awareness
• Clarity
• Formatting
• Instruction Following
• Project Rubrics Adherence
• Remote Team Management
• Discord
• Google Sheets
• Google Docs
• Project Management Systems
• AI Training Data
• Data Annotation
• LLM Evaluation
• Scientific QA
• Academic Review
• Psychology Content Review
• Rubric-Based Review

Work Environment and Contract Details

This is a remote, full-time contract position. The role requires working within fast-moving remote environments utilizing common collaboration and project management tools. While specific project assignments are not immediate, candidates will be considered for future opportunities within YO IT Consulting's AI Data Services division.