About this opening
Exclusive Talent Management is hiring a Senior QA Automation Engineer in Abu Dhabi, on a contract basis, to test an AI platform where many outputs are not deterministic. Alongside ordinary integration and performance testing, the role builds automated checks for generative AI outputs, retrieval pipelines and prompt changes.
What the role involves
- Build automated frameworks that evaluate generative AI outputs for hallucination, consistency and factual accuracy against reference datasets
- Automate checks of retrieval-augmented generation pipelines, including citation and relevance measures, and regression suites for prompt changes
- Build integration tests that validate data consistency between AI agents and enterprise systems such as SAP
- Design performance tests for the latency and throughput of forecasting and risk-scoring engines, and automate secure API testing
- Map automated test cases to system requirements for verification and validation evidence and stage-gate reviews
- Manage the defect feedback loop, tracing AI defects back to specific model versions or datasets
Requirements noted by the source board
- Expert proficiency in Python for test harnesses, with automation libraries for UI and API testing
- Expert proficiency in performance test planning and implementation with tools such as Locust, JMeter or k6
- Experience with frameworks for evaluating LLMs, and with creating and managing ground-truth datasets
- Proficiency with SQL and data validation tools, and experience integrating automated tests into CI/CD pipelines
- 5+ years in QA automation, including at least 2 years on data-driven, ML or AI applications (as listed on the board)
Not stated by the source: the contract length — the source listing lists this opening as a contract role without stating its length, so confirm the length and the full package on the source listing before you apply.
How to apply
Apply on the source board — Gulf Salary Hub does not accept applications and cannot forward your CV. Open a source listing below, check the full details there, and apply on that board:
Trust note: Listed from public job boards. Gulf Salary Hub is a guide, not an agent — we never charge any fee. Apply at the source, and beware anyone who asks for money for a job.
Before you apply: 1) Get the offer in writing — salary, overtime and accommodation named in the document, not promised in a chat. 2) Use only a licensed OEP, verify the job before paying anything (how to verify), and travel only with the Protector of Emigrants stamp on your passport. 3) Never pay a fee to Gulf Salary Hub — we are a guide, not an agent; we charge nothing, ever.
Before you apply anywhere, read our safety guide: Verify an Agent & Avoid Job Scams. A genuine employer or board never asks a worker to pay for a job offer.