Astronomer QA Lead📣 إعلان

About the Role

YO IT Consulting is seeking an Astronomer Quality Assurance Lead for a remote, contract position. In this role, you will be responsible for overseeing the quality, consistency, and performance of AI training projects focused on astronomy and astrophysics. Your expertise will directly contribute to enhancing leading AI models by ensuring training data is accurate, scientifically sound, clearly explained, well-documented, and meets client expectations.

Role Overview and Selection Process

This is an hourly, remote contractor role. While there is no immediate project assignment, qualified candidates will be prioritized for future opportunities within YO IT Consulting's expert network. The selection process includes an AI interview, a domain-specific task, and an interview with a recruiter. Successful candidates will gain access to a pipeline of upcoming projects.

Key Duties and Responsibilities

• Review AI-generated astronomy/astrophysics content and the work of trainers and QA personnel.
• Evaluate output quality against established project guidelines and rubrics.
• Provide precise, written feedback to contributors.
• Ensure all contributors adhere to expected quality standards.
• Assess work for scientific accuracy, physical reasoning, mathematical correctness, terminology quality, unit handling, observational context, clarity, formatting, instruction adherence, and rubric compliance.
• Identify recurring quality issues and trends.
• Communicate project updates, guidelines, and expectations to trainers and QAs.
• Support the onboarding process for new team members.
• Maintain and update project documentation, including style guides and FAQs.
• Assist in activating contributors who are not working consistently.
• Conduct scientific reviews of explanations, calculations, diagrams, and interpretations for accuracy and clarity.
• Respond to trainer and QA questions regarding physical assumptions, units, terminology, and rubric interpretation.
• Manage trainer/QA activation by encouraging engagement and tracking follow-ups.
• Flag misleading, overconfident, physically impossible, or poorly sourced claims.
• Propose workflow improvements and contribute to scalable QA processes.

Qualifications and Experience

• Bachelor’s, Master’s, or PhD degree in Astronomy, Astrophysics, Physics, Space Science, Planetary Science, Cosmology, or a closely related field.
• 3-5 years of experience in astronomy/astrophysics research, teaching, science communication, academic review, data analysis, observatory work, or related scientific workflows.
• Strong understanding of celestial mechanics, stellar evolution, galaxies, cosmology, electromagnetic radiation, observational methods, spectroscopy, planetary systems, black holes, and scientific uncertainty.
• Ability to evaluate content against detailed rubrics and identify specific issues such as incorrect physical assumptions, wrong units, flawed calculations, or misleading explanations.
• Experience leading or supporting remote teams of researchers, educators, reviewers, annotators, science writers, or QAs is strongly preferred.
• Experience with AI training, data annotation, LLM evaluation, scientific QA, academic review, or rubric-based review is a strong plus.

Required Skills and Competencies

• Strong command of the English language for clear communication and written feedback.
• Proficiency in evaluating astronomy/astrophysics content for scientific accuracy and adherence to guidelines.
• Familiarity with tools such as Python, astronomical datasets, telescope/observatory data, spectroscopy, photometry, simulations, LaTeX, Jupyter notebooks, or scientific visualization is preferred.
• Comfort working in fast-paced remote environments using tools like Discord, Google Sheets, Google Docs, trackers, dashboards, and project management systems.
• Highly detail-oriented and organized with strong documentation skills.