QA Analyst

On behalf of our client, we are seeking a QA Analyst to join their team in Al Khobar. The QA Analyst will play a critical role in executing and automating functional and non-functional testing for Generative AI-driven applications, ensuring that AI models, APIs, and user interfaces are reliable, scalable, and secure. The role will cover end-to-end and integration testing, AI model and data validation, test automation, API testing, performance testing, and post-deployment testing. The position requires strong hands-on experience in QA and test automation, with Python as a must-have and additional emphasis on Playwright, Pytest, SQL, and coding experience in Python.

Responsibilities

• Execute end-to-end and integration testing to validate AI-driven actions and ensure products function according to specified requirements
• Validate workflows, user journeys, API interactions, and AI model outputs against business logic
• Conduct UI/UX testing to validate accessibility, responsiveness, and usability across devices and browsers
• Support user acceptance testing activities
• Validate input datasets for training, testing, and fine-tuning of AI models
• Ensure data integrity, preprocessing workflows, and real-world alignment of synthetic data
• Validate data pipelines and data flow between AI models, backend services, and frontend applications
• Test models against predefined scenarios, including edge cases and adversarial inputs
• Support performance, load, and stress testing using tools such as JMeter
• Automate test cases for regression and frequent deployments
• Validate new builds, releases, and updates continuously
• Track defects, log issues, and verify fixes in collaboration with development teams
• Monitor production model performance and analyse results for quality improvements
• Implement test automation for functional and regression testing
• Conduct API testing using Postman and SoapUI. Assist in security and compliance validation and ensure data protection and regulatory adherence
• Desired Candidate Profile 3-5 years of experience in quality assurance, with a focus on functional and integration testing
• Playwright experience — mandatory
• Pytest experience
• Hands-on SQL experience
• Hands-on coding experience in Python
• Proficiency in test automation tools including Selenium, Cypress, and Robot Framework
• API testing experience using Postman and SoapUI. Strong knowledge of AI model validation techniques and data integrity testing
• LLM evaluation experience is a plus
• Familiarity with performance testing tools such as JMeter
• Security testing experience is an advantage
• Experience working in Agile environments with CI/CD pipeline integration
• Strong analytical skills with attention to detail in test execution and reporting