Similar Jobs
See allAI-native QA Engineer
Jobgether
United Arab Emirates
Python
REST APIs
SQL
Senior Software Engineer, Assurance
Omada Health
US
Python
JavaScript
GitLab CI/CD
AI & Test Automation Architect
Expleo
Germany
Selenium
Playwright
CI/CD
Senior SDET / Test Automation Engineer
Truelogic
Global
TypeScript
Node.js
Playwright
QA/UAT Engineer
Nylas
US
Go
Playwright
REST APIs
Responsibilities:
- Design, develop, and maintain automated test suites for web applications, APIs, and AI-powered features.
- Evaluate LLM outputs for response accuracy, relevance, consistency, and hallucination risks.
- Create prompt tests and quality checks using Promptfoo or similar LLM evaluation frameworks.
Qualifications:
- Strong experience in QA Automation and software testing - 5+ years.
- Hands-on experience testing AI or LLM-based features, including prompt testing and output validation.
- Strong proficiency in Playwright for end-to-end UI automation and Python scripting.
Additional Information:
- Project involves a global consulting company delivering digital and AI solutions for various industries.
- Collaborate closely with product managers, developers, and stakeholders to define test strategies.
- Actively contribute to Agile ceremonies, including refinement sessions and sprint planning.
Nagarro
Nagarro is a digital product engineering company that builds products, services, and experiences across all devices and digital mediums. With over 18,000 experts in 39 countries, we have a dynamic and non-hierarchical work culture.