AI Quality Assurance Engineer

About the Role

TawanTech is seeking an AI Quality Assurance Engineer to join their team in Riyadh, Riyadh Province. This full-time role is responsible for ensuring the quality, reliability, accuracy, and performance of AI/ML solutions throughout the development lifecycle. The position involves developing and implementing testing strategies for AI models, data pipelines, AI applications, and production deployments, ensuring solutions meet business, technical, security, and regulatory requirements.

Key Responsibilities

• Develop and execute comprehensive QA and testing strategies for AI/ML solutions.
• Validate AI models for accuracy, consistency, robustness, and performance.
• Design test cases for machine learning models, AI applications, APIs, and data pipelines.
• Perform data quality, data validation, and data integrity testing.
• Test AI outputs for accuracy, bias, hallucination, reliability, and consistency where applicable.
• Conduct regression, integration, functional, performance, and automated testing.
• Establish quality gates and acceptance criteria for AI model deployment.
• Monitor model performance and identify model/data drift in production.
• Collaborate with Data Scientists, AI Engineers, Data Engineers, and Business stakeholders.
• Automate testing processes and integrate QA activities into CI/CD pipelines.
• Document defects, test results, risks, and remediation activities.
• Support model governance, auditability, and compliance requirements.

Experience and Qualifications

Candidates for this role should possess 5 to 10 years of relevant experience in quality assurance for AI/ML solutions. The position requires a strong understanding of AI/ML development lifecycles and testing methodologies.

Work Environment

This is a full-time position based in Riyadh, offering an opportunity to work within a collaborative environment focused on advancing AI/ML solutions.