Source Job

Canada

  • Architect, design, and lead implementation of scalable cloud infrastructure for AI/ML workloads.
  • Build and optimize specialized CI/CD pipelines covering the full ML lifecycle.
  • Collaborate with AI researchers and software engineers to streamline experimentation and production deployment.

Kubernetes Docker Python Terraform MLflow

20 jobs similar to Principal DevOps Engineer (AI/ML Infrastructure)

Jobs ranked by similarity.

Canada

  • Architect and lead scalable AI/ML infrastructure with a focus on automation and security.
  • Build and maintain CI/CD pipelines for AI models from data ingestion to deployment.
  • Mentor junior engineers and collaborate with AI researchers to optimize performance.

Revvity provides end-to-end solutions for scientists and clinicians to tackle health challenges. With over 11,000 global colleagues, we combine disruptor energy with established leadership to push boundaries in human health.

$200,000–$230,000/yr

  • Build and maintain internal CLIs, SDKs, and services in Python or Go for deploying and debugging AI agents.
  • Deploy, scale, and tune LLM inference with vLLM, including GPU scheduling and cost/latency trade-offs.
  • Own MLOps workflows, Kubernetes operators, and CI/CD to take AI agents from laptop to production.

Tessera Labs builds multi-agent AI systems that automate complex enterprise workflows across platforms like SAP, Salesforce, and Snowflake. Backed by Foundation Capital, the startup operates with extreme ownership and a fast-moving culture at the frontier of applied AI.

Global 5w PTO

  • Define the technical direction and architecture for a rapidly expanding GPU cluster platform.
  • Lead and mentor a team of senior infrastructure engineers while staying hands-on with complex systems.
  • Establish security strategies and operational practices to ensure reliable, efficient AI experiments.

This organization powers cutting-edge AI research through large-scale GPU cluster infrastructure. It fosters a collaborative, fast-moving environment where engineers work closely with researchers.

India

  • Run, maintain, and scale production cloud infrastructure for a platform processing terabytes of data daily.
  • Own CI/CD pipelines, containerised environments, and infrastructure for AI agents with observability and cost controls.
  • Collaborate with a flat engineering team of 14+ professionals, reporting to the VP of Engineering and AI.

Smart Working breaks down geographic barriers and connects skilled professionals with outstanding global teams for full-time, long-term remote roles. The company is a remote-first community focused on growth and well-being, and is rated highly on Glassdoor.

US

  • Own cloud infrastructure and ensure security, observability, and scalability for AI-powered grid inspection.
  • Manage Kubernetes clusters, databases, and CI/CD pipelines using Terraform and GitOps.
  • Work closely with ML and platform teams to support high-volume image processing and inference.

Buzz Solutions uses AI to keep the power grid safe and reliable. It is a small team where engineers own real systems and see their work in customers' hands quickly.

US

  • Build and scale the core infrastructure powering Vectara's AI agent platform.
  • Lead backend services, CI/CD, and observability initiatives with a focus on reliability.
  • Mentor team members and champion best practices in code quality and DevOps.

Vectara is an AI agent platform that builds secure, scalable infrastructure for AI-powered search and assistants. The team values engineering excellence, automation, and collaboration as they scale their platform.

Canada

  • Design scalable, secure AWS architectures and lead systems decisions for resilience.
  • Implement IaC with Terraform, CDK, or CloudFormation; optimize CI/CD pipelines.
  • Integrate AI tools into workflows, mentor engineers, and enforce security standards.

$93,896–$110,467/yr
Canada

  • Design, automate, and improve the software delivery platform for scalability and reliability.
  • Build tooling and guardrails for AI agent workflows and scale cloud infrastructure.
  • Own end-to-end delivery of complex features and mentor engineers in best practices.

ThoughtExchange builds an AI-powered platform that helps leaders connect with communities and uncover actionable insights. The company fosters a remote-first culture with a collaborative team focused on innovation and inclusion.

India

  • Own DevOps and delivery for AI workloads, building and operating CI/CD/CV pipelines that ship AI services reliably.
  • Build observability, cost management, and governance for AI runtime across cloud, on-prem, edge, and air-gapped environments.
  • Operate high-performance GPU inference and model-serving systems with end-to-end telemetry and FinOps discipline.

Zimperium is a global leader in AI-empowered mobile security, protecting mobile applications and devices from advanced threats. The company is fast-growing and builds autonomous security solutions to safeguard critical mobile infrastructures.

US Europe

  • Lead and build a dedicated platform team to deploy, operate, and audit the Data Intelligence Platform across public cloud, private cloud, and on-premises environments.
  • Design cloud-agnostic deployments using Kubernetes, Terraform, and GitOps, and own platform services including the data catalog, knowledge graph, and integration APIs.
  • Treat AI as part of the platform by running AI agents for operations, retiring redundant tools, and building infrastructure for AI and ML workloads.

Actian is the company behind the Data Intelligence Platform, an enterprise solution that helps organizations discover, govern, and trust their data at scale. They operate globally, move fast, and build for the long term, fostering a culture of autonomy, outcomes, and builders over theorists.

Global

  • Design and build LLM serving infrastructure on Kubernetes, including GPU scheduling, scaling, and model lifecycle management.
  • Package the platform for enterprise environments using Helm and integrate with API gateway, identity, and metering services.
  • Build observability for GPU inference in production, including serving metrics and GPU telemetry.

Mirantis is a Kubernetes-native AI infrastructure company that helps organizations build and operate scalable infrastructure for AI and data-intensive applications. With a culture of openness and collaboration, Mirantis is an established leader in cloud infrastructure, serving Fortune 500 and Global 2000 customers.

$2,500–$4,000/mo
US

  • Design, build, and maintain infrastructure for training, fine-tuning, and serving large language models.
  • Deploy and scale LLM inference services, manage GPU compute, and optimize workload scheduling and utilization.
  • Automate deployment workflows with infrastructure-as-code and CI/CD, and collaborate with ML engineers to move models to production.

Hire Hangar connects top talent with vetted employers and offers competitive pay and real growth opportunities. It focuses on matching remote contractors with fast-growing global companies.

$160,000–$190,000/yr
US Unlimited PTO

  • Design, build, and productionize machine learning and agentic AI functionality.
  • Partner with product engineering squads to embed AI capabilities into Arkestro's product.
  • Contribute to AI/ML architecture decisions and own evals and ground truth for your projects.

Arkestro's Predictive Procurement Platform applies AI, game theory, and behavioral science to enterprise negotiations, helping teams move from reactive supplier bidding to data-driven offers. It is a hyper-growth, remote-first startup with a collaborative culture focused on meaningful work and significant impact.

Europe

  • Build and run automated infrastructure for CI/CD pipelines, deployments, and environments.
  • Work with AI agents daily and own every line that ships into production.
  • Join a small, senior team where you have direct access to expert users and immediate feedback.

TubeScience Labs creates trusted, scalable, and self-improving AI systems for the largest performance-based paid social creative video company. We are a small, senior team of engineers and product managers with direct access to expert users.

$107,300–$125,800/yr
Canada

  • Lead the evolution of cloud infrastructure and DevOps practices using Terraform and Kubernetes to support EV charging networks.
  • Drive security, observability, and CI/CD automation across the stack, including AI workloads and agentic workflows.
  • Mentor engineers and set technical direction while partnering with product and data teams to scale a high-availability platform.

Terawatt Infrastructure builds and operates large-scale charging solutions for electric and autonomous vehicle fleets, combining capital, real estate, and technology. It's a growing, mission-driven team that values ownership, candor, and progress toward sustainable transport.

$38,000–$48,000/yr
Latin America Unlimited PTO

  • Build small to medium-sized infrastructure components using Terraform and AWS.
  • Maintain and debug CI/CD workflows with GitHub Actions and ArgoCD.
  • Use AI code assistants and observability tools to automate tasks and troubleshoot system issues.

TrueML is a mission-driven financial software company that uses machine learning to create better customer experiences for distressed borrowers. The TrueML team includes inspired data scientists, financial services experts and customer experience fanatics, and is dedicated to diversity and inclusion.

  • Own and scale production infrastructure across GCP and GPU cloud providers using Kubernetes, Docker, and Terraform.
  • Continuously improve inference performance, latency, and GPU utilisation through profiling and experimentation.
  • Ensure production reliability by monitoring critical systems and responding to incidents outside UK hours.

Neuphonic is building the next generation of voice AI, making natural, real-time speech accessible across devices, languages, and applications. We are a small, ambitious team of researchers and engineers whose open-source releases have reached millions of downloads and we're growing quickly.

$180,000–$230,000/yr
US Unlimited PTO

  • Drive architectural decisions across the [R]AIMS platform, balancing performance, scalability, security, and maintainability.
  • Lead major technical epics from conception through delivery, decomposing ambiguous problems into executable plans.
  • Mentor engineers, conduct design reviews, and raise technical execution across the platform.

Raft is a customer-obsessed, non-traditional defense technology company focused on AI/ML and data solutions for U.S. military and government agencies. Its culture emphasizes radical transparency, hyper-collaboration, and innovation with a mission-driven focus.

  • Lead deployment and configuration of x86 servers, Linux, virtualization, and core infrastructure services for AI clusters.
  • Optimize high-performance storage platforms like WEKA and VAST, and validate performance, resilience, and integration.
  • Provide Tier 3 escalation and automate provisioning, identity, and infrastructure-as-code using Ansible, Terraform, and Python.

Highrise AI is a GPU-native infrastructure platform delivering scalable compute for modern AI workloads across dedicated clusters, managed cloud, and confidential environments. As a subsidiary of Hut 8 Corp., it operates next-generation GPU clusters with disciplined operations and a growing global team of engineers and builders.

US

  • Drive bottom-up adoption of AI-native development workflows across product teams through coaching and cross-team alignment.
  • Architect markdown-driven artifact pipelines and deterministic guardrails to modernize the entire SDLC.
  • Design continuous evaluation infrastructure and closed-loop operations to enable self-testing and autonomous maintenance.

Addepar is a global data and AI platform empowering investment professionals to turn complex financial information into actionable intelligence. With over 1,500 firms using its platform and offices worldwide, Addepar fosters a culture of ownership, collaboration, and innovation.