Source Job

$125,000–$150,000/yr
US

  • Validate the quality, reliability, and safety of AI-powered systems across the platform.
  • Design, build, and maintain automated test suites for API, UI, security, and performance.
  • Collaborate cross-functionally with Engineering, QA, Product, and Operations teams.

Playwright SQL CI/CD API Testing

20 jobs similar to AI Test Engineer II

Jobs ranked by similarity.

US

  • Design, build, and maintain automated test coverage across Authenticx's healthcare conversation intelligence platform, including UI, API, integration, and data-level testing.
  • Partner with Product, Engineering, Data Science, and Customer teams to translate real customer workflows and product risks into meaningful automated scenarios.
  • Validate AI-powered features and integrate automated tests into CI/CD pipelines to ensure release confidence and high-quality outcomes.

Authenticx is a fast-growing, venture-backed, enterprise AI company transforming healthcare through conversation intelligence. We help healthcare organizations uncover insights hidden in millions of customer interactions to improve patient, member, and business outcomes.

US Canada Costa Rica

  • Build and maintain scalable automation suites using Playwright across web, API, and mobile, integrating with CI/CD.
  • Use AI coding assistants like Claude Code and GitHub Copilot to generate and validate tests, ensuring robust coverage.
  • Collaborate with QA peers and engineers to embed quality gates early and track metrics to reduce defect escape rates.

Backcountry is an outdoor retailer that celebrates adventure and exploration, offering gear and apparel for various outdoor activities. The company fosters a culture rooted in energy, connection, and wellbeing, with a remote-first approach and a focus on employee recognition and outdoor perks.

$70,000–$95,000/yr
Canada Latin America

  • Strengthen and modernize automated test suites across unit, integration, and end-to-end testing.
  • Build and evolve shared test frameworks, CI/CD pipelines, and quality gates.
  • Drive agentic quality tooling with AI-powered test generation, code review, and verification.

This partner company builds reliable software in an AI-driven development environment, focusing on quality engineering and developer empowerment. Its culture is collaborative and international, with continuous improvement and diverse perspectives.

US

  • Design, develop, and maintain automated test frameworks using TypeScript, Python, Pytest, and Playwright.
  • Collaborate with engineers and QA teams to define testing strategies and ensure comprehensive coverage.
  • Explore and leverage AI tools to improve test generation, defect prediction, and test optimization.

Zact is a fintech company building simpler expense and payment management systems that align spending employees with finance and accounting. It operates as a global company with teams across the US, Europe, and India, offering a fully remote, collaborative culture.

Bulgaria 5w PTO

  • Design, implement, and maintain automated UI, API, and integration tests with Playwright using JavaScript/TypeScript and/or Python.
  • Use AI-assisted tools to speed up test design, refactoring, and failure analysis while ensuring output quality and data-handling compliance.
  • Drive testing depth through regression, critical-path testing, and risk prioritization, collaborating closely with developers and product owners.

Appfire creates software that empowers teams to break silos and collaborate seamlessly, with products like JXL, Comala Document Management, and BigPicture. With 800+ employees working remotely across 28 countries, the company values flexibility and a remote-first culture.

  • Design and maintain scalable Playwright test suites using the Page Object Model.
  • Perform functional, exploratory, and regression testing for web applications.
  • Collaborate with developers and QA teams to improve testability and quality.

Applaudo is an AI-native organization that designs, builds, and scales AI-powered solutions for business impact. They foster a high-performance culture with values like Empowering Excellence and Collaborative Teamwork, and they are building a team of talented professionals who want to learn fast and take ownership.

Europe

  • Automates validation across UI, APIs, and dashboards.
  • Performs manual testing of features including test design and regression.
  • Collaborates with engineering and product teams to clarify requirements.

INFUSE is a company that develops software products and ensures quality through rigorous testing. They offer a fully remote work environment with a collaborative and creative culture that values initiative and experimentation.

$148,350–$203,550/yr
US

  • Define the long-term testing strategy for Expert Research built on Quality by Design and Automation by Default.
  • Close test coverage gaps on critical workflows like call scheduling, expert sourcing, compliance, and transcript review.
  • Build scalable E2E automation, test AI-powered features, and coach engineers on quality across teams.

AlphaSense is an AI platform redefining market intelligence and workflow orchestration, trusted by thousands of leading organizations for faster business and finance decisions. We combine proprietary AI with 500M+ business documents and are growing quickly, with a culture focused on speed, accuracy, and security.

$100,000–$130,000/yr
US

  • Execute rigorous manual and automated testing to ensure product quality, reliability, and safety.
  • Build test automation from scratch using Python, Playwright/Selenium/Cypress, and CI/CD integration.
  • Own quality end-to-end, mentor teammates, and collaborate with developers and product teams.

PerfectServe provides clinical communication and physician scheduling solutions in health IT. With 400+ employees and 30,000+ customers, it fosters a collaborative, tech-forward culture focused on improving patient care.

US

  • Own test automation strategy for your domain, balancing delivery speed with suite health.
  • Build scalable frameworks and partner with engineers to improve testability and release risk.
  • Drive quality with risk assessments, AI-assisted testing, and radiologist-centric test cases.

Rad AI is a healthcare AI company that develops AI-driven solutions for radiology to save time, reduce burnout, and improve patient care. The company has raised over $140M, with a $528M valuation, and is recognized as a fast-growing leader in healthcare AI.

$150,000–$210,000/yr
United States

  • Convert high-value regression suites into maintainable automated tests.
  • Engineer and maintain core primitives that AI test-writing agents consume to generate valid tests.
  • Monitor test run performance, optimize suite execution speed, and triage flaky tests to ensure high signal in CI.

Syllo is on a mission to transform litigation with a unified litigation platform that lets lawyers and paralegals safely harness language models and agentic AI. The company has gained enterprise customers including major law firms and corporations and is quickly expanding.

QA Lead

Baselane
$100,000–$130,000/yr
US

  • Build and maintain Playwright test automation covering critical user flows, APIs, and regression suites.
  • Lead and mentor a manual QA team, upskilling them into automation while setting quality standards.
  • Integrate automated tests into CI/CD pipelines and work with Engineering and DevOps to own quality end-to-end.

Baselane is a banking and financial management platform for individual landlords and real estate investors. It is a rapidly growing fintech company backed by leading investors, with a seasoned team experienced in financial services and technology.

5w PTO

  • Design and maintain Playwright (TypeScript/JavaScript) automation frameworks for UI and API testing.
  • Work collaboratively with developers and clients using BDD, and diagnose flaky tests to find root causes.
  • Use AI coding agents to speed up test design and help define AI-assisted testing practices.

Valtech is an experience innovation company that partners with global brands to drive digital transformation. The company offers a borderless, collaborative culture and values-driven environment focused on growth and innovation.

  • Design and extend AI-powered test harnesses where agents plan, execute, and analyze test scenarios.
  • Build and maintain automated UI, API, and integration test suites in CI/CD pipelines.
  • Use AI tools to accelerate test design and failure analysis, mentoring engineers on automation practices.

Allata is a global consulting and technology services firm that partners with enterprises to move AI from idea to production. With 350+ employees across the US, India, and Argentina, they build intelligent agents, data foundations, and governance frameworks.

Bulgaria 5w PTO

  • Hold the top individual contributor level for QA, staying hands-on with Playwright automation and AI-assisted testing.
  • Act as the primary technical escalation for unstable suites, CI bottlenecks, test data issues, and critical regressions.
  • Mentor QA engineers on Playwright, CI, and AI-assisted workflows, championing reusable patterns across squads.

We create software that empowers teams to break silos and collaborate seamlessly, with flagship products like JXL and BigPicture. We are a team of 800+ employees working remotely across 28 countries, with a culture of flexibility and ownership.

US

  • Develop and execute end-to-end automated test coverage for GenAI features using Python and test automation frameworks.
  • Implement testing strategies for LLM-powered applications, including conversational AI, agentic systems, and prompt testing.
  • Support evaluation frameworks, adversarial testing, and CI/CD integration to ensure AI reliability, accuracy, and safety.

Anaplan provides an AI-infused scenario planning and analysis platform that helps businesses optimize decision-making. With over 2,400 global customers including Fortune 50 companies, Anaplan fosters a Winning Culture focused on innovation, diversity, and inclusion.

Global

  • Perform functional testing of frontends and APIs, analyze results, and identify defects with clear bug reports.
  • Design validation approaches for AI-driven and non-deterministic outputs, covering quality, consistency, and guardrails.
  • Collaborate with customer support, product, and developers throughout the development process, advocating for quality early.

SplitMetrics is a global software company providing a suite of products and services for mobile app growth, including Apple Ads automation, A/B testing, and ASO tools. With over 11 years in mobile marketing, the company operates across 20+ countries with a remote-first, supportive culture.

  • Design and implement automated test cases for functional, regression, and integration testing.
  • Develop and maintain automated testing frameworks using tools such as Playwright and Artillery.
  • Collaborate with developers, product managers, and UX teams to define testing strategies and acceptance criteria.

Poland 8w PTO

  • Build and refactor critical Playwright automation (UI and API) and evolve shared patterns, standards, and quality gates across squads.
  • Act as the primary technical escalation for unstable suites, CI bottlenecks, test data and environment issues, and critical-path regressions.
  • Define and improve test data and environment patterns (isolation, parallelism, fixtures) so automation scales reliably in CI/CD.

Appfire creates software that empowers teams to collaborate seamlessly, with flagship products like JXL and BigPicture. The company has over 800 employees working remotely across 28 countries.