Source Job

$180,000–$230,000/yr
US Unlimited PTO

  • Drive architectural decisions across the [R]AIMS platform, balancing performance, scalability, security, and maintainability.
  • Lead major technical epics from conception through delivery, decomposing ambiguous problems into executable plans.
  • Mentor engineers, conduct design reviews, and raise technical execution across the platform.

Kubernetes Distributed Systems AI/ML Software Engineering System Design

20 jobs similar to Lead AI/ML Software Engineer

Jobs ranked by similarity.

US

  • Build and operate shared AI infrastructure enabling secure access to foundation models.
  • Work on model gateways, cloud AI services, routing, observability, and governance.
  • Mentor and coach engineers, contributing to technical roadmaps and code reviews.

Aledade is a healthcare technology company that empowers independent primary care practices through value-based care. The company maintains a collaborative, mission-driven engineering culture focused on building scalable, reliable systems.

$200,000–$250,000/yr
US Unlimited PTO

  • Own hands-on technical contribution, team leadership, and delivery accountability for the engineering organization.
  • Manage technical execution, architecture, engineering quality, and production reliability with a focus on security.
  • Partner cross-functionally with product, customer experience, and leadership to drive platform vision.

Authorium is a high-growth GovTech SaaS company that helps government agencies modernize administrative operations by replacing legacy systems with a unified platform. The team is small but growing, moves fast, and collaborates across on-shore and off-shore squads to deliver mission-critical software.

US

  • Own security solutioning for k0rdent AI across the full stack, from hardware to AI models.
  • Publish reference architectures and proofs of concept with customers and partners.
  • Research emerging threats and present to engineers, executives, and conference audiences.

Mirantis, an IREN company, is the Kubernetes-native AI infrastructure company enabling organizations to build scalable, secure infrastructure for AI and data-intensive applications. It is a distributed, world-class team committed to openness and technical excellence.

US

  • Lead client-facing engineering and solutioning from pre-sales through early delivery for enterprise AI platforms.
  • Architect and implement AI stacks, agentic solutions, and cloud-native platforms using Python, GenAI, and LLMs.
  • Drive AIOps, observability, and mission-critical platform transformation programs for regulated industries.

Global technology consulting and digital solutions company that enables enterprises to reimagine operations and drive measurable business impact. Its Enterprise AI business unit focuses on scaled, production-grade AI adoption and agentic platforms.

$190,000–$230,000/yr
US

  • Design and implement scalable cloud infrastructure using Kubernetes, Pub/Sub, and distributed systems technologies.
  • Collaborate with our AI team to optimize data pipelines and integrate AI to remove performance bottlenecks.
  • Drive platform reliability initiatives including alerting, health checking, and incident management.

Syllo is building a unified litigation platform that helps lawyers and paralegals use AI throughout the litigation life cycle. We are a quickly expanding company with enterprise customers including major law firms and corporations.

Global 5w PTO

  • Define the technical direction and architecture for a rapidly expanding GPU cluster platform.
  • Lead and mentor a team of senior infrastructure engineers while staying hands-on with complex systems.
  • Establish security strategies and operational practices to ensure reliable, efficient AI experiments.

This organization powers cutting-edge AI research through large-scale GPU cluster infrastructure. It fosters a collaborative, fast-moving environment where engineers work closely with researchers.

US Unlimited PTO

  • Field CTO for customer engagements, owning prototyping and deployment of AI solutions.
  • Work closely with engineering, research, and business teams supporting national security customers.
  • Travel up to 50% to customer sites for scoping and implementation.

EdgeRunner AI is an American dual-use research lab building frontier open-weight AI for the U.S. military and regulated industries. As a Series-A startup with $17.5M in funding, we are a fast-moving, remote-first team focused on national security.

US

  • Build and operate shared infrastructure for AI platform capabilities, including model gateways and cloud AI services.
  • Shape product strategy and execution across disciplines, developing scalable and performant solutions.
  • Mentor and coach engineers, setting standards for code architecture and engineering processes.

Aledade is a healthcare technology company that empowers independent primary care practices through value-based care and accountable care organizations. The company is dedicated to improving health outcomes and supporting communities, with a collaborative and innovative culture.

$170,000–$170,000/yr
Global 7w PTO

  • Lead the engineering foundation behind reliable, measurable, and scalable AI-powered features.
  • Build evaluation frameworks, observability tooling, and diagnostic infrastructure for AI agents in production.
  • Combine hands-on software engineering with technical leadership and people management.

The company builds AI-powered products with a focus on reliability, scalability, and evaluation infrastructure. It operates as a fully remote, globally distributed team with an ownership-oriented culture.

Saudi Arabia

  • Lead technical discovery and design end-to-end architectures for AI, analytics, and cloud-native data platforms.
  • Own proof-of-concept delivery from scope through production planning and drive technical outcomes.
  • Serve as a trusted advisor on object storage, Kubernetes, and AI workloads across the data stack.

MinIO is the data and memory foundation for enterprise AI, providing AIStor and MemKV to unify data across core, edge, and cloud. Trusted by 77% of the Fortune 100, it is an equal-opportunity, customer-first culture.

North America

  • Set the technical direction for ServiceNow's Health Log Analytics data platform across collection, ingestion, storage, and query.
  • Partner with engineering, product, and customers to shape the roadmap and turn feedback into clear, actionable plans.
  • Raise the bar through design reviews, mentoring engineers, and leading reliability and efficiency improvements.

ServiceNow is the AI control tower for business reinvention, bringing together any AI, any data, and any workflow to help 85% of the Fortune 500 work smarter. The company fosters an AI-native culture where technology and talent are unstoppable together, freeing people from busywork to focus on meaningful work.

$160,900–$260,700/yr
Global

  • Design, build, and operate production AI agents for developer productivity, from code review to incident response.
  • Build self-service platform infrastructure enabling teams to prototype, deploy, and scale their own AI developer tools.
  • Integrate LLM providers, agent orchestration frameworks, and MCP servers into reliable, loved developer tools.

Docker is a developer tooling company trusted by over 20 million monthly users for building, sharing, and running applications. We are a globally distributed, remote-first team building AI-powered tools that shape how software gets built and delivered.

$200,000–$300,000/yr
US

  • Plan, configure, test, and roll out deployments across customer VPC and on-premises environments.
  • Partner with customer IT, security, and platform teams to resolve infrastructure issues.
  • Build monitoring, telemetry, and automation for scalable processes.

US

  • Lead cloud engineering strategy and execution for Kaseya's AI-powered IT management platform.
  • Drive architecture, scalability, and reliability of cloud infrastructure across global endpoints.
  • Mentor and grow engineering teams while collaborating with product and operations leadership.

Kaseya is the leading provider of AI-powered IT management and cybersecurity software, serving Managed Service Providers and internal IT organizations worldwide. Backed by Insight Partners, the company supports customers in over 20 countries, manages more than 15 million endpoints, and fosters a builder culture.

$170,350–$275,550/yr
Global

  • Set technical direction and own architecture for AI-powered developer tools and the self-service platform.
  • Design and build production AI agents, LLM integrations, and platform infrastructure for developer productivity.
  • Mentor engineers, lead design reviews, and drive cross-team technical delivery across Docker.

Docker provides developer tools for building, sharing, and running applications, trusted by over 20 million monthly users. They are a globally distributed, remote-first team focused on AI-native software development and platform engineering.

$160,000–$190,000/yr
US Unlimited PTO

  • Design, build, and productionize machine learning and agentic AI functionality.
  • Partner with product engineering squads to embed AI capabilities into Arkestro's product.
  • Contribute to AI/ML architecture decisions and own evals and ground truth for your projects.

Arkestro's Predictive Procurement Platform applies AI, game theory, and behavioral science to enterprise negotiations, helping teams move from reactive supplier bidding to data-driven offers. It is a hyper-growth, remote-first startup with a collaborative culture focused on meaningful work and significant impact.

$97,600–$139,000/yr
United States Canada

  • Build and maintain core infrastructure for Quora's ML platform, ensuring high availability, scalability, and performance.
  • Build and improve distributed systems serving ML models in production, from Large Recommendation Models to Large Language Models.
  • Work on GPU model serving, optimizing latency, throughput, and cost to support larger and more capable models.

Quora's mission is to grow the world's collective intelligence through two platforms: Quora for global knowledge sharing and Poe for AI agent collaboration. We are a remote-first company with passionate, collaborative, and high-performing global teams, rooted in transparency and experimentation.

Global 6w PTO 26w maternity 26w paternity

  • Build production-ready infrastructure for autonomous AI agents, including secure code execution, state management, and model routing.
  • Collaborate with research teams to turn emerging ML ideas into scalable, fault-tolerant distributed systems.
  • Prototype and evaluate new technologies for agent workflows, from identity to resource management.

Cohere is a security-first enterprise AI company building foundation models and end-to-end products for real-world problems. We are a global team of engineers, researchers, and designers passionate about our craft, with offices worldwide.

US

  • Lead the strategic direction, engineering, and operational management of enterprise cloud and infrastructure platforms.
  • Own the cloud operating model, including service catalog, SLAs/SLOs, governance, and cost optimization.
  • Build and develop a team of cloud platform engineers, SREs, and security engineers, driving reliability and automation.

Banner Health is one of the largest nonprofit health care systems in the country, delivering hospital services and advanced technology. They offer a comprehensive benefits package and a culture centered on making health care easier for every employee.

$81,000–$156,600/yr
Global

  • Architect core vCluster Platform features, diving deep into Kubernetes internals.
  • Write high-performance, resilient Go code for the platform and open-source projects.
  • Own features end-to-end from design to release, solving hard systems challenges.

We're the #1 platform for AI infrastructure, trusted by the world's fastest-growing AI cloud builders. We're a venture-backed startup of 40+ engineers, remote-first, powering 100K+ GPUs across 50+ AI clouds and Fortune 500 companies.