Source Job

20 jobs similar to Senior Software Development Engineer in Test (SDET), QA - AI Systems

Jobs ranked by similarity.

US

  • Develop and execute end-to-end automated test coverage for GenAI features using Python and test automation frameworks.
  • Implement testing strategies for LLM-powered applications, including conversational AI, agentic systems, and prompt testing.
  • Support evaluation frameworks, adversarial testing, and CI/CD integration to ensure AI reliability, accuracy, and safety.

Anaplan provides an AI-infused scenario planning and analysis platform that helps businesses optimize decision-making. With over 2,400 global customers including Fortune 50 companies, Anaplan fosters a Winning Culture focused on innovation, diversity, and inclusion.

US Unlimited PTO

  • Build scalable quality strategies and automated regression infrastructure for AI-assisted software transformation workflows.
  • Diagnose complex failures across C/C++, Rust, Python, build systems, and heterogeneous target environments.
  • Lead quality engineering practices, mentor engineers, and partner with Engineering, Research, and Solutions on release evidence.

Code Metal automates software engineering, using formal methods to verify AI-written code, with customers like the U.S. Air Force, RTX, and Toshiba. Founded in 2023, the Boston/SF startup is backed by Accel and Salesforce Ventures.

India

  • Lead quality engineering and AI testing initiatives for reliable, scalable, and secure cloud-based software.
  • Design automated test suites for Java-based backend services, REST APIs, and AI-powered features including LLM validation.
  • Integrate testing into CI/CD pipelines and conduct AI security testing including prompt injection and adversarial validation.

The company develops cloud-based software solutions for complex risk and decision-making environments, hosted on AWS and Azure. It fosters an inclusive culture that values curiosity, diverse perspectives, integrity, innovation, and continuous learning.

$150,000–$170,000/yr
Global

  • Design, build, and maintain automated test suites across API, UI, security, and performance/load testing.
  • Use AI-based testing tools like Claude Code and Copilot to generate, refactor, and scale tests, integrating them into CI/CD pipelines.
  • Validate data integrity, test distributed services, and support root cause analysis in an Agile environment.

TREND Health Partners is a tech-enabled payment integrity company that facilitates collaboration between payers and providers to reduce waste and improve healthcare access. It is a dynamic growing organization with a collaborative and innovative work environment.

$80,000–$100,000/yr
US

  • Own quality end to end across Decile Hub and Start Fund, catching issues before they reach fund managers or LPs.
  • Build and maintain AI agents that run regression tests, explore features, and automatically flag risks.
  • Partner with engineering, product, and customer success to turn customer insights into test cases and release checks.

At Decile Group, we're transforming venture capital into a force for good with an integrated platform spanning education, software, and fund operations. We're working to launch 10,000 next-generation venture capital firms by 2030, and we build with a proactive, agentic team that owns quality end to end.

North America

  • Design and maintain automated end-to-end tests for our ecosystem of internal and external systems.
  • Apply evaluation frameworks for AI/LLM-powered features to define and test quality.
  • Partner with engineers to embed testing into CI/CD and shift-left quality practices.

Forward Financing is a Boston-based fintech unlocking capital for small businesses across America. It has provided $5B+ in funding, earned Great Place to Work and Built In Best Place to Work honors, and spans the US, Dominican Republic, and Canada.

$84,240–$146,050/yr
Europe 4w PTO

  • Build AI agents that take action: tools, prompts, guardrails, and multi-turn workflows with memory.
  • Ship the full experience: in-product chat, streaming responses, permission-aware APIs, and MCP server.
  • Make quality measurable: build evals, catch regressions, and use production feedback to improve quality, latency, and cost.

Muck Rack builds an AI-powered PR platform that helps organizations understand their brand across news, social media, and AI answers. It is a founder-controlled, fully distributed firm trusted by 3,000+ organizations, with an inclusive, customer-first culture.

$196,984–$222,000/yr
US

  • Design, build and operate production AI agents, including an autonomous coding agent that works from Jira and Slack, opening PRs and fixing CI failures.
  • Build the retrieval and context layer behind our AI brain: embeddings, semantic search, knowledge-graph modeling, and integration with Snowflake and internal docs.
  • Harden agents against prompt injection and over-broad permissions, and drive cost and latency down using caching and structured outputs.

Weedmaps is a global leader in the cannabis industry, providing a platform for consumers and businesses. The company has a collaborative culture focused on innovation and community, serving the U.S. and worldwide.

US

  • Build AI-powered agents and tools end-to-end: identify problems with clients, prototype quickly, evaluate rigorously, and ship to production.
  • Design and implement LLM integrations including prompt engineering, function calling, structured outputs, and retrieval-augmented workflows.
  • Work directly with clients to understand workflows, validate AI behavior, and iterate toward production quality.

Addepar is a global data and AI platform empowering investment professionals to turn complex financial information into actionable intelligence. With over 1,500 firms in 60 countries and nearly $10 trillion in assets on the platform, Addepar fosters a culture of ownership, collaboration, and continuous learning.

Global Unlimited PTO

  • Design, build, and operate AI agents across the testing lifecycle, including test design, generation, maintenance, execution, and failure triage.
  • Own test infrastructure, environments, tool interfaces, guardrails, runtime management, and cost controls.
  • Drive adoption of quality engineering tools and practices across teams.

Quality Austria Security & IT specializes in next-generation quality engineering through AI-powered testing and intelligent automation. Their culture emphasizes autonomy, collaboration, experimentation, and engineering quality in a fully remote, global engineering environment.

Global

  • Design and build automated evaluation pipelines for AI agents.
  • Develop testing frameworks for reasoning, multi-turn conversations, and adversarial scenarios.
  • Own the evaluation architecture and integrate observability tools in a fully remote team.

A company building production-grade AI agents and systems. They operate in a fully remote, globally distributed environment with a culture focused on innovation, autonomy, and continuous improvement.

US Canada Costa Rica

  • Build and maintain scalable automation suites using Playwright across web, API, and mobile, integrating with CI/CD.
  • Use AI coding assistants like Claude Code and GitHub Copilot to generate and validate tests, ensuring robust coverage.
  • Collaborate with QA peers and engineers to embed quality gates early and track metrics to reduce defect escape rates.

Backcountry is an outdoor retailer that celebrates adventure and exploration, offering gear and apparel for various outdoor activities. The company fosters a culture rooted in energy, connection, and wellbeing, with a remote-first approach and a focus on employee recognition and outdoor perks.

US Unlimited PTO

  • Perform risk-based exploratory, functional, regression, and integration testing across complex SaaS systems, APIs, databases, and document-processing pipelines.
  • Use AI as a testing co-pilot to analyze code changes, generate test scenarios, investigate issues, and improve coverage across user interfaces and backend services.
  • Collaborate with engineers and product managers to establish testable acceptance criteria, reproduce production issues, and maintain targeted automated checks with tools like Playwright.

They operate a technology platform that processes critical legal documents and workflows. The company is a fast-moving, AI-assisted engineering organization with a collaborative, quality-focused culture.

Europe 6w PTO

  • Own agent quality end-to-end for Bliro's chat and voice agents, including prompting, context, and model evaluation.
  • Build eval sets, LLM judges, and benchmarks to measure quality, latency, and cost with statistical rigor.
  • Establish a repeatable process for improving agent quality and set the long-term technology roadmap.

Bliro builds an AI assistant that handles desk work for field sales teams, with over one million customer touchpoints documented. Backed by leading investors and trusted by German Mittelstand companies, it's a small, high-performing team that values ownership and continuous improvement.

$198,000–$281,000/yr
US 4w PTO 12w maternity 12w paternity

  • Design, build, and maintain shared automation frameworks, internal services, and developer tools for QA and engineering teams.
  • Develop and evaluate AI-assisted testing capabilities and integrate security checks into CI/CD workflows.
  • Collaborate across QA, Engineering, and Security to drive adoption of reusable testing practices and tools.

Quanata is a technology company in the State Farm family focused on building reliable, secure software platforms. They are a remote-first employer with a collaborative culture and a commitment to employee growth and veteran hiring.

US

  • Design and build autonomous AI agents using modern agentic frameworks to analyze infrastructure and make intelligent decisions.
  • Develop and deploy ML models and MLOps pipelines that learn from infrastructure patterns to optimize resource policies and scaling.
  • Own AI systems end-to-end, from architecture to production, ensuring performance, reliability, and cost-effectiveness.

ScaleOps is redefining autonomous cloud and AI infrastructure by freeing DevOps teams from manual resource management, reducing cloud costs by up to 80%. Backed by over $210M from leading VCs, the company is trusted by Fortune 100 companies and fosters an innovative, mission-driven culture.

$143,800–$231,900/yr
Global

  • Build and operate agents across the testing lifecycle — test design, generation, maintenance, execution and failure triage.
  • Own the infrastructure that makes agent-driven testing reliable: environments, test data, tool interfaces, guardrails, runtime and cost control.
  • Define how we measure agent output quality, so teams can trust results instead of hand-reviewing them.

Camunda is the enterprise platform for agentic orchestration, enabling coordination of AI agents, people, and systems across business processes. Trusted by over 700 organizations, we are a fast-growing, fully remote company with a culture of ownership and innovation.

US

  • Set the technical direction for AI engineering across the team: agent architecture patterns, evaluation methodology, deployment and monitoring strategies
  • Design the AI platform layer, including shared agent frameworks, tool integrations, and evaluation infrastructure
  • Work directly with clients on the most complex engagements, identifying new problem domains and ensuring production quality

Addepar is a global data and AI platform empowering investment professionals to turn complex financial information into actionable intelligence. With over 1,500 firms in 60 countries managing nearly $10 trillion in assets, Addepar fosters a culture of ownership, collaboration, and innovation.

$88,000–$180,000/yr
US Unlimited PTO

  • Direct the agent array on production workstreams by decomposing problems into tasks and integrating agent output into shipped software.
  • Review agent-generated pull requests at volume and depth, identifying correctness, security, and accessibility defects.
  • Author evaluation suites that make quality measurable using eval-driven development and own end-to-end quality within a FedRAMP-authorized environment.

Granicus provides cloud-based solutions for government communications, website design, meeting management, and records management, serving over 5,500 agencies and 300 million citizens. With a globally distributed team and a culture of transparency and inclusion, Granicus has been recognized on the GovTech 100 list for the past 5 years.

$160,900–$260,700/yr
Global

  • Design, build, and operate production AI agents for developer productivity, from code review to incident response.
  • Build self-service platform infrastructure enabling teams to prototype, deploy, and scale their own AI developer tools.
  • Integrate LLM providers, agent orchestration frameworks, and MCP servers into reliable, loved developer tools.

Docker is a developer tooling company trusted by over 20 million monthly users for building, sharing, and running applications. We are a globally distributed, remote-first team building AI-powered tools that shape how software gets built and delivered.