Political Science QA Lead📣 Job Ad

About the Role

YO IT Consulting is seeking a Political Science Quality Assurance Lead for a remote, contract-based role. This position involves overseeing the quality and consistency of political science AI training projects, ensuring the accuracy, balance, and alignment of training data with client expectations. The role is with a rapidly growing AI Data Services company that supports major AI companies and foundation-model labs. While there is no immediate project assigned, qualified candidates will be prioritized for future opportunities within the company's expert network.

Key Responsibilities

• Conduct spot-checks on political science content, identify quality issues, and provide feedback.
• Evaluate AI-generated political science explanations, comparative analyses, policy summaries, and discussions for accuracy and balance.
• Communicate project updates, guidelines, and quality standards to trainers and QAs via Discord.
• Respond to questions regarding political science concepts, bias, and rubric interpretation.
• Monitor contributor activity, encourage engagement, and flag availability concerns.
• Develop and maintain project documentation, including style guides, FAQs, and onboarding materials.
• Schedule and conduct onboarding and training sessions for trainers and QAs.
• Ensure consistent application of political science review guidelines by all contributors.
• Flag misleading, one-sided, unsupported, or inflammatory claims.
• Identify recurring quality gaps and propose workflow improvements for scalable QA processes.

Core Duties

The core duties involve reviewing AI-generated political science content and the work of trainers and QAs. This includes evaluating output quality against project guidelines, providing precise written feedback, and ensuring all contributors adhere to expected quality standards. Assessment will cover conceptual accuracy, institutional knowledge, comparative context, political theory, policy reasoning, bias sensitivity, clarity, and adherence to project-specific rubrics.

Required Qualifications

• A Bachelor's, Master's, or PhD degree in Political Science, International Relations, Public Policy, Government, Political Theory, Law, Sociology, Economics, or a related social science field.
• A minimum of 3 years of experience in political science research, teaching, policy analysis, public affairs, political writing, or academic review.
• A strong understanding of political institutions, comparative politics, international relations, public policy, political theory, and political behavior.
• The ability to evaluate political science content against detailed rubrics and identify specific issues such as oversimplification, ideological bias, or unsupported claims.
• Proficiency in English for following guidelines and providing clear written feedback.

Preferred Skills and Experience

• Familiarity with areas such as democracy and authoritarianism, political economy, public administration, or international organizations.
• Experience leading or supporting remote teams of analysts, researchers, or QAs.
• Comfort working in fast-paced remote environments using tools like Discord, Google Sheets, and project management systems.
• Experience with AI training, data annotation, LLM evaluation, or academic review is a strong advantage.

Work Arrangement

This is a remote, contract-based position. The required experience for this role is between 2 to 5 years. Salary is not disclosed.