Source Job

US Unlimited PTO

  • Evaluate AI systems at a scale only possible by combining thousands of vetted experts with model graders.
  • Innovate at the frontier of QA by shaping industry standards for validating agentic AI and large language models.
  • Collaborate with global market leaders to architect AI quality blueprints and drive high-impact consultative visibility.

Data Science AI Evaluation Software Engineering Consultative Communication

20 jobs similar to AI Solutions Architect

Jobs ranked by similarity.

Brazil

  • Own and evolve an AI evaluation harness to rigorously test AI agents and non-deterministic outputs.
  • Design automated evaluations, adversarial test cases, and benchmark comparisons to expose edge cases and logic failures.
  • Validate regulatory quality gates and compliance requirements, including frameworks such as SR 26-2 and NYDFS Regulation 187.

Jobgether is an AI-powered job matching platform that connects candidates with hiring companies. It uses AI to review applications and share top-fitting candidates with employers, focusing on efficient and fair recruitment.

Global

  • Own and build evaluation pipelines for AI workflows to define metrics, benchmarks, and acceptance criteria.
  • Drive continuous improvement of AI performance through quantitative analysis, prompting strategies, and workflow design.
  • Ensure reliability, monitoring, and stability of AI systems with dashboards, alerts, and failure detection.

HiPeople is an AI Hiring Platform that automates screening, interviews, assessments, and references for recruiting teams. They are a lean startup backed by leading investors, aiming to reach $10M ARR with fewer than 20 people, and work with brands like the NFL and Zapier.

$139,000–$202,000/yr
Canada US

  • Design and build internal AI services that help sellers create tailored sales assets and respond to deal signals.
  • Integrate AI agents with platforms like Salesforce, Snowflake, and Slack for permission-aware tool use.
  • Evaluate and improve agent behavior through user feedback, quality signals, and production monitoring.

1Password builds a secure digital future with unified access management and enterprise password management, trusted by over 180,000 businesses. They are a remote-first company with a culture of collaboration and innovation, and have surpassed $400M in ARR, earning a spot on the Forbes Cloud 100.

$194,600–$361,400/yr
US

  • Lead rapid prototyping and technical validation of agentic AI solutions and autonomous workflows.
  • Evaluate foundation models, agent frameworks, and orchestration technologies for enterprise adoption.
  • Mentor AI engineers and promote strong engineering practices across teams.

This partner company is hiring for a senior technical leadership role focused on shaping next-generation AI agents and autonomous workflows. They are a collaborative enterprise with a culture centered on experimentation, continuous learning, and innovation, offering a remote opportunity in the US.

US Unlimited PTO

  • Architect and deploy autonomous AI agents and multi-agent workflows for privacy-first systems.
  • Build scalable backend services using FastAPI and orchestrate agentic workflows with LangGraph in AWS or Azure.
  • Develop rigorous evaluation pipelines for accuracy, citation adherence, latency, and reliability.

Osano is a leading data privacy platform that helps organizations comply with global privacy regulations like GDPR and CCPA. Backed by top-tier investors and recognized as a Great Place to Work for four years running, the company has a 97% employee satisfaction rate and a mission-driven, fast-growing culture.

$152,100–$190,100/yr
US

  • Identify and map workflows to find step-change opportunities for AI automation.
  • Design and build future-state workflows using agents, integrations, and human-in-the-loop checkpoints.
  • Deploy and run agents in production, tracking KPIs and iterating on performance.

Natera is a global leader in cell-free DNA testing, focusing on oncology, women's health, and organ health. The company employs a diverse team of dedicated professionals from world-class institutions, fostering a collaborative and inclusive culture.

Global 5w PTO

  • Design and ship AI agent systems end to end, owning data access, retrieval, and integration with existing infrastructure.
  • Build evaluation frameworks from scratch, including golden datasets and regression harnesses, and think adversarially about prompt injection and data boundary violations.
  • Set technical direction for AI at Kota and collaborate across teams to surface new AI opportunities.

Kota is reimagining insurance and retirement benefits for the modern workforce. We have raised over €20M, serve tens of thousands of employees, and operate with a remote-first culture.

$130,000–$175,000/yr
Global

  • Build and ship LLM-powered applications and AI agent workflows.
  • Design systems for reasoning, planning, memory, tool use and multi-step execution.
  • Build evaluation frameworks to measure AI quality and reliability.

Gina's Tech Jobs is an IT staffing and recruiting agency that specializes in placing technology professionals. They partner with companies to fill roles such as this one, offering a wide range of positions.

$100,000–$150,000/yr
US

  • You will design the architecture for specialized subagents operating within live customer conversations, including technical QA, product expertise, and objection handling.
  • You will build routing and delegation systems that determine when to answer directly, invoke a subagent, or escalate to a human.
  • You will master the dialogue platform, train AI agents via prompting and fine-tuning, and document workflows to educate the team.

1mind builds autonomous customer experience software that deploys AI-powered 'Superhumans' to engage, demo, onboard, and support customers across the entire buying journey. The company offers a remote-first, fast-moving culture with ownership, autonomy, and impact from day one.

$170,000–$190,000/yr
Global Unlimited PTO

  • Design and deploy scalable AI infrastructure and agent systems for enterprise customers.
  • Work on Kubernetes cluster design, multi-agent system architecture, and CI/CD pipelines.
  • Engage directly with customers to assess needs and present technical recommendations.

LangChain builds the foundation for agent engineering, helping developers create production-ready AI agents. With $125M raised at Series B from top venture firms and 100M+ monthly open source downloads, they have a strong engineering culture and meaningful team impact.

Latin America

  • Design end-to-end agentic architectures using LLMs and automation tools like n8n, Make, and AWS Step Functions.
  • Lead client discovery sessions to identify AI opportunities and present technical recommendations focused on ROI.
  • Implement integrations and automation pipelines, collaborating with data engineering teams on MLOps.

Bluelight is a software consultancy that designs and develops innovative technology. With a presence across the US and Central/South America, it fosters a collaborative, growing environment.

US

  • Design and iterate on agent behavior across real, live workflows, including long-horizon, multi-turn agentic tasks.
  • Build and run evaluations against production conditions to measure performance, regressions, and edge cases.
  • Partner with Product and Engineering to ensure agents are steerable, trustworthy, and ready for scale.

Arcadia is a healthcare platform that transforms complex data into trusted intelligence for providers, payers, and life sciences organizations. Backed by Nordic Capital, the company has hundreds of organizational clients and a mission-driven culture focused on improving patient outcomes.

Global

  • Lead the delivery of AI projects end-to-end, establishing technical standards and mentoring a high-performing team.
  • Guide the design and delivery of RAG systems, agentic frameworks, and LLM-powered solutions for production.
  • Develop evaluation frameworks and quality standards to ensure reliable AI system performance.

Blend is a premier AI services provider that co-creates impactful solutions using data science, AI, and technology. The company fosters a culture of innovation and collaboration, with a focus on aligning human expertise with artificial intelligence.

North America

  • Own the end-to-end technical relationship with enterprise customers, translating business challenges into AI solutions on the Moveworks Platform.
  • Architect and deliver high-impact AI solutions, leveraging the Moveworks Platform and developing novel AI agent frameworks.
  • Design secure integrations between Moveworks and customer enterprise systems like ServiceNow, Workday, and Jira.

ServiceNow is the AI control tower for business reinvention, bringing together AI, data, and workflows to help 85% of the Fortune 500 work smarter. They have a large, global workforce and foster an AI-native culture where technology and talent are unstoppable.

AI Engineer

Ditto
Global Unlimited PTO

  • Build the agent execution runtime: Design and ship the layer that compiles a brief into a running team of agents.
  • Design the tool surface agents work through: Replace "here is a shell, please be careful" with typed, versioned toolpacks.
  • Make quality measurable, then improve it: Build the evals, benchmarks, and metric sets that score a run.

Ditto is redefining how data moves at the edge by providing a peer-to-peer sync engine for developers to build resilient, real-time applications without internet. With over $145 million in funding and trusted by organizations like Chick-fil-A and Delta Airlines, we are a globally distributed startup committed to building a diverse and inclusive team.

Canada

  • Establish quality engineering practices for AI-powered chatbot products, including testing strategies and release processes.
  • Design evaluation methods for non-deterministic LLM systems, focusing on reliability, performance, and safety.
  • Collaborate with engineers and product teams to integrate quality throughout development and mentor peers.

The company specializes in AI-powered conversational products, building next-generation chatbot capabilities. They work in multidisciplinary teams with a focus on reliability and innovation in a remote-first environment.

$165,000–$210,000/yr
US

  • Lead the design and delivery of AI agents and automation workflows for NBCU's data collaboration ecosystem.
  • Guide development of reusable tools, APIs, and components for agentic and software engineering workflows.
  • Oversee production-grade Python application design, testing, and CI/CD practices to ensure reliability and scalability.

NBCUniversal is one of the world's leading media and entertainment companies, creating and distributing content across film, TV, streaming, and theme parks. As a subsidiary of Comcast, it fosters an inclusive culture and supports community engagement through employee-driven initiatives.

Canada

  • Lead AI validation strategies for LLMs, RAG systems, and AI agent workflows.
  • Build automated validation pipelines and evaluation frameworks for AI output quality.
  • Establish production monitoring, AI guardrails, and quality metrics for AI products.

Jobgether is an AI-powered recruitment platform connecting candidates with hiring companies. It has a collaborative, remote-first culture and uses AI to streamline hiring.

  • Design and implement production-grade agentic AI solutions for slot/casino game production, including game math engines, backend, and client code.
  • Act as embedded technical lead, running technical demos, producing follow-up packs, and transferring knowledge to client teams.
  • Build custom agentic setups that are transferable across AI systems, owning architecture, deployment patterns, and cost estimation.

Neurons Lab accelerates AI adoption for iGaming companies, designing and building agentic AI solutions for game production. They are a consulting firm engaged by a group of iGaming studios to deliver production-ready prototypes, operating with a Talent Network freelance model and seeking experienced technical leads.

Global

  • Design end-to-end architecture for AI-driven solutions with a focus on Generative AI.
  • Engage in AI pre-sales activities including client workshops, discovery sessions, and technical presentations.
  • Define and oversee implementation of AI solutions such as RAG pipelines, vector search, and LLM integrations.

We develop solutions that make an impact for companies around the globe. We build cross-functional engineering teams and embrace a culture of openness, respect, grit, and enjoyment.