Philosophy QA Lead📣 Job Ad

About the Role

YO IT Consulting is seeking a Philosophy Quality Assurance Lead for a contract, hourly, remote position. This role is crucial for overseeing quality, consistency, and trainer performance within philosophy-focused AI training projects. Your expertise will directly contribute to enhancing premier AI models by ensuring philosophy training data is conceptually precise, logically sound, well-contextualized, nuanced, and aligned with client expectations. This position is with a rapidly growing AI Data Services company that provides training data for leading AI companies and foundation-model labs.

Role Overview and Purpose

As a Philosophy Quality Assurance Lead, you will be responsible for maintaining high standards in AI-generated philosophy content and the work of trainers and quality assurance personnel. The objective is to ensure the accuracy, coherence, and adherence to project guidelines of the training data, thereby improving the quality of AI models.

Key Responsibilities

• Review AI-generated philosophy content and the work of trainers and QA personnel.
• Evaluate output quality against established project guidelines and rubrics.
• Provide precise, written feedback to contributors.
• Ensure all contributors adhere to expected quality standards.
• Assess work for conceptual accuracy, argument structure, logical validity, philosophical context, interpretation quality, clarity, nuance, formatting, instruction adherence, and rubric compliance.
• Identify and report recurring quality issues.
• Communicate updates and feedback to trainers and QAs.
• Support the onboarding process for new contributors.
• Maintain and update project documentation.
• Assist in engaging contributors who are not working consistently.

Qualifications and Experience

• Bachelor's, Master's, or PhD degree in Philosophy, Ethics, Logic, Political Theory, Humanities, Religious Studies, Classics, Cognitive Science, or a closely related field.
• A strong command of the English language for understanding guidelines, team communication, and providing clear written feedback.
• Minimum of 3 years of experience in philosophy research, teaching, writing, editing, academic review, ethics review, logic instruction, or related humanities workflows.
• A solid understanding of philosophical methods, logic, argument analysis, ethics, epistemology, metaphysics, philosophy of mind, political philosophy, history of philosophy, and conceptual clarification.
• Ability to evaluate philosophy content against detailed rubrics and identify issues such as strawman arguments, invalid inference, conceptual confusion, oversimplification, unsupported claims, false equivalence, or misrepresentation of philosophers’ views.
• Familiarity with areas such as formal logic, moral philosophy, applied ethics, analytic philosophy, continental philosophy, ancient philosophy, political philosophy, philosophy of science, or AI ethics is preferred.
• Experience leading or supporting remote teams of researchers, writers, reviewers, educators, annotators, or QAs is strongly preferred.
• Proficiency in using remote work tools such as Discord, Google Sheets, Google Docs, trackers, dashboards, and project management systems.
• Highly detail-oriented and organized, with the ability to manage style guides, FAQs, trackers, onboarding materials, calibration tasks, and documentation.
• Experience with AI training, data annotation, LLM evaluation, academic QA, ethics review, or rubric-based review is a strong plus.

Work Arrangement and Opportunity

This is a contract, hourly, remote position. While there is no immediate project assignment for this role, qualified candidates will be prioritized for future relevant opportunities. This also provides access to future projects through the company's expert network. The selection process includes an AI interview, a domain-specific task, and an interview with a recruiter.