Sociology QA Lead📣 Job Ad

About the Role

YO IT Consulting is seeking a Sociology Quality Assurance Lead for a remote, contract role. This position focuses on overseeing quality, consistency, and trainer performance for sociology-focused AI training projects. Your expertise will be instrumental in enhancing AI models by ensuring sociology training data is accurate, nuanced, ethically aware, research-informed, and aligned with client expectations. This role is with a rapidly growing AI Data Services company that provides training data for major AI companies and foundation-model labs.

Role Overview and Impact

As a Sociology Quality Assurance Lead, you will play a critical role in ensuring the integrity and quality of sociological data used in AI development. Your work will directly contribute to the accuracy and ethical considerations of advanced AI models. This is a remote, contract position with an hourly rate that is not disclosed.

Key Responsibilities

• Conduct spot checks on sociology-related content, identify quality issues, provide direct feedback, and escalate significant problems.
• Evaluate AI-generated explanations, theory applications, research summaries, social policy discussions, demographic interpretations, and reasoning for accuracy and nuance.
• Communicate updates on guidelines, project changes, workflows, and quality expectations to trainers and QAs via Discord.
• Respond promptly to questions regarding sociological concepts, theory, research methods, inequality, culture, ethics, bias, and rubric interpretation.
• Monitor contributor activity, encourage engagement, track follow-ups, and report availability issues.
• Develop and maintain project documentation, including style guides, trackers, FAQs, quality notes, and onboarding materials.
• Schedule and lead onboarding and training sessions for trainers and QAs.
• Ensure consistent application of sociology review guidelines and understanding of project updates.
• Identify and flag instances of stereotyping, stigmatizing language, unsupported claims, weak causal reasoning, or ethically problematic social analysis.
• Propose workflow improvements and contribute to the development of scalable QA processes.

Qualifications and Experience

• Bachelor’s, Master’s, or PhD degree in Sociology, Social Sciences, Social Research, Demography, Criminology, Gender Studies, Ethnic Studies, Public Policy, Anthropology, or a closely related field.
• A minimum of 3 years of experience in sociology research, teaching, social policy analysis, qualitative/quantitative research, academic writing, social science review, community research, or related areas.
• Strong command of the English language for clear communication and feedback.
• In-depth understanding of sociological theory, social institutions, inequality, stratification, race/ethnicity, gender, class, culture, deviance, organizations, social change, demography, and research methods.
• Ability to critically evaluate sociology content against detailed rubrics and identify specific issues.
• Experience leading or supporting remote teams of researchers, educators, analysts, reviewers, annotators, or QAs is strongly preferred.
• Familiarity with areas such as survey research, interviews, ethnography, statistical analysis, social policy, urban sociology, family sociology, education, health disparities, work/organizations, or criminology is preferred.
• Experience with AI training, data annotation, LLM evaluation, social science QA, academic review, or rubric-based review is a strong plus.

Work Environment and Process

This is a remote contract role. Candidates should be comfortable working in fast-moving remote environments using tools such as Discord, Google Sheets, Google Docs, trackers, and project management systems. The selection process includes an AI interview, a domain-specific task, and an interview with a recruiter. While there is no immediate project, qualified candidates will be contacted for future relevant opportunities and gain access to the company's expert network.