AI Quality Assurance Engineer📣 Job Ad

About Arabot

Arabot, established in 2016, operates as MENA’s leading semantic automation platform, integrating AI with service fulfillment to achieve business objectives. The company addresses complex business and technical challenges daily within its field.

The Role of AI Quality Assurance Engineer

Arabot is seeking an AI Quality Assurance Engineer to join its team in Jeddah, Makkah, Saudi Arabia. This full-time role is dedicated to ensuring the quality, reliability, and performance of AI-powered applications. The position requires experience in testing LLM-based applications, AI workflows, prompt quality, and implementing automated testing for intelligent systems.

Key Responsibilities

• Develop and execute comprehensive test strategies specifically for AI and agentic AI applications.
• Validate AI workflows, prompts, and LLM responses to ensure their accuracy, consistency, and reliability.
• Design and implement both automated and manual test cases tailored for AI-powered solutions.
• Perform various types of software testing, including functional, integration, regression, and performance testing.
• Identify, document, and track defects systematically throughout the software development lifecycle.
• Collaborate closely with AI Engineers and relevant stakeholders to gain a clear understanding of business requirements and expected AI behavior.
• Establish and monitor AI quality metrics, actively contributing to continuous improvement initiatives.
• Provide essential support for release validation processes and ongoing production monitoring.

Required Qualifications and Experience

• 2-5 years of experience as a Quality Assurance Engineer, with a focus on AI solutions.
• Demonstrated knowledge of API testing and various software testing methodologies.
• Experience working effectively within Agile development environments.

Essential Skills

• Strong analytical capabilities and effective troubleshooting skills.
• Proficiency in documentation practices.
• Good communication and collaboration skills.

Work Location

This is a full-time position based in Jeddah, Makkah, Saudi Arabia.