Source Job

$179,000–$199,000/yr
United States

  • Design, build, and maintain foundational AI platform components including model gateways, vector databases, and LLM evaluation frameworks.
  • Develop secure platform architectures with integrated authentication, authorization, and access control mechanisms.
  • Build and enhance observability solutions for AI workloads and partner with teams to integrate AI infrastructure with agent frameworks.

Kubernetes OpenTelemetry MLflow VLLM

20 jobs similar to Principal AI Platform Engineer

Jobs ranked by similarity.

Hungary

  • Design and run Kubernetes environments optimized for AI inference, retrieval, experimentation, and agent execution in secure or isolated settings.
  • Deploy and operate open-source or open-weight model stacks, model gateways, vector databases, and supporting platform components.
  • Build reproducible platform automation using Infrastructure as Code and GitOps approaches for stable, auditable delivery.

Deutsche Telekom IT Solutions is a subsidiary of Deutsche Telekom Group, providing IT and telecommunications services. It has over 5300 employees and has been recognized as Hungary's most attractive employer and most ethical multinational company.

US 20w maternity 12w paternity

  • Own end-to-end technical execution for strategic customer and partner engagements, including discovery, infrastructure design, implementation, and production deployment.
  • Design and build cloud infrastructure supporting advanced AI workloads, including simulation, training, evaluation, inference, and large-scale batch processing.
  • Improve platform reliability, security, performance, and cost efficiency by debugging issues across application, network, storage, compute, and orchestration layers.

The partner company is building the infrastructure foundation for next-generation AI applications and physical AI workloads. The engineering team is pioneering and values ownership, technical excellence, and solving challenging engineering problems at scale.

US Unlimited PTO

  • Own and scale AI compute and deployment platforms including Kubernetes and GitOps pipelines.
  • Build inference infrastructure and observability stacks for LLM-powered workflows.
  • Drive security, compliance, and governance at the systems level in a regulated healthcare environment.

Hims & Hers is a leading health and wellness platform focused on making healthcare accessible and personal. As a publicly traded company on the NYSE (HIMS), it offers flexible/remote work and a culture centered on innovation and employee well-being.

EMEA

  • Build and operate production-grade model serving infrastructure using vLLM, TGI, or Triton frameworks.
  • Design and implement auto-scaling, multi-model architectures, and intelligent request routing for ML inference.
  • Optimize GPU utilization, memory efficiency, and observability to ensure low-latency, cost-effective systems.

They are a distributed cloud infrastructure startup building AI-native cloud services with GPU-powered compute. The company is well-funded, fast-scaling, and operates in a remote-first environment with a focus on sustainability and decentralization.

$107,950–$139,700/yr
UK

  • Build and maintain backend services, Python libraries, and model lifecycle tooling for internal ML teams.
  • Design and operate distributed systems for model serving, evaluation, and feature engineering.
  • Focus on developer experience and reliability to help teams train, deploy, and serve ML models safely.

Monzo is on a mission to make money work for everyone, offering personal and business bank accounts, savings, investments, and more through a modern digital banking platform. With around 600 engineers out of roughly 5,000 employees, we value flexibility, collaboration, and open source contributions.

EU

  • Design, build, and maintain platform infrastructure using IaC principles with tools like Terraform.
  • Develop memory services, vector storage patterns, and semantic search capabilities.
  • Operate a Kubernetes-based platform for the Data & AI department, enabling deployment and scaling via GitOps.

Redcare Pharmacy is Europe's No.1 e-pharmacy, striving to improve global health through innovation and collaboration. The company fosters a healthy, inclusive work environment where employees feel valued and inspired.

Canada

  • Lead the design and operation of GPU infrastructure for AI workloads.
  • Manage Kubernetes-based environments and optimize for AI training and inference.
  • Define operational standards, implement monitoring, and collaborate with AI engineering teams.

ELEKS is a software engineering company that partners with enterprises to accelerate digital transformation. They have a global team of over 2,000 professionals and foster a culture of innovation and collaboration.

US Unlimited PTO 20w maternity 20w paternity

  • Design, build, and maintain highly available Kubernetes infrastructure at scale.
  • Lead design for components and features, and contribute to architecture decisions for container orchestration.
  • Mentor engineers on Kubernetes best practices and drive initiatives to improve system reliability.

Marqeta provides a card issuing platform for companies to issue cards, authorize transactions, and manage payment operations in real time. They are a publicly-traded company with a Flex First culture that values remote work and employee growth.

US Canada

  • Define security architecture and build controls for AI platforms, training and inference workflows, and agentic systems.
  • Design reusable security patterns for identity, authorization, and runtime controls to constrain execution and data exposure.
  • Lead hands-on security reviews and influence security architecture through practical design changes and reusable controls.

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs, delivering industry-leading training and inference speeds. With dozens of model releases and rapid growth, they have a non-corporate work culture that respects individual beliefs.

$100,000–$150,000/yr
United States

  • Design, deploy, and operate service mesh platforms (Istio and Linkerd) across multi-cluster Kubernetes environments.
  • Implement mTLS, certificate lifecycle automation, and workload identity propagation for secure communication.
  • Build and enhance observability for service-to-service communication using tracing, metrics, and topology insights.

Jobgether uses AI-powered matching to connect candidates with roles. They focus on efficient hiring processes and data privacy.

Netherlands

  • Design and scale highly reliable platform systems supporting complex cloud-native workloads across multiple deployment environments.
  • Build and enhance core platform services while contributing to distributed systems, event-driven architectures, and cloud-native infrastructure.
  • Optimize cloud resources, networking, storage, compute, and observability to improve system performance, scalability, reliability, and maintainability.

Jobgether uses an AI-powered matching process to connect candidates with hiring companies. They operate as a job platform, processing applications and sharing top candidates with employers.

$185,000–$200,000/yr
US Unlimited PTO 16w maternity 4w paternity

  • Build and operate the ML lifecycle platform, including tooling for experiment tracking, model registry, and versioned pipelines.
  • Own CI/CD and deployment for ML workloads, building automated pipelines from notebook to production.
  • Make models observable and reliable in production with monitoring for latency, drift, data quality, and cost signals.

dv01 provides a data analytics platform for the structured finance market, offering transparency into investment performance and risk for lenders and Wall Street investors. With over 400 clients and coverage of over 100 million loans, dv01 is a data-first company with a diverse and innovative culture.

$100,000–$150,000/yr
United States

  • Architect, deploy, and manage Red Hat OpenShift clusters across on-prem and cloud environments.
  • Automate cluster lifecycle operations using GitOps and infrastructure-as-code tools.
  • Enable application teams through self-service onboarding, CI/CD integration, and platform documentation.

Jobgether uses an AI-powered matching process to connect candidates with hiring companies. The company focuses on objective, fair review of applications and shares shortlists directly with employers.

$100,000–$120,000/yr
US Unlimited PTO

  • Build and operate the delivery platform across AWS, EKS, ArgoCD, Helm, and Terraform, fixing production problems and driving root-cause analysis.
  • Standardize CI/CD pipelines using GitHub Actions and Azure DevOps, implement progressive delivery with Argo Rollouts, and build observability with Grafana and Prometheus.
  • Support platform adoption, reduce toil and cost, unblock cross-team delivery, and write documentation to eliminate knowledge silos.

Attain Finance is a leading consumer credit lender with over 50 years of expertise providing credit solutions across the U.S. and Canada. The company employs a dynamic team that fosters innovation and collaboration, with a portfolio including brands like Cash Money, LendDirect, Heights Finance, and others.

Global Unlimited PTO

  • Build enterprise-scale infrastructure using infrastructure-as-code and Kubernetes-native systems.
  • Sustain platform health and performance by owning critical systems in production.
  • Enable teams and customers to move faster with abstractions and tooling for AI/ML workloads.

Cake makes cutting-edge AI accessible to enterprise teams by removing infrastructure barriers, enabling 10x faster and cheaper AI/ML platform deployment. Backed by top investors, they have a small senior team focused on ownership and operational excellence.

US Unlimited PTO 18w maternity 12w paternity

  • Lead technical implementations and drive adoption of Chainguard images for secure software development.
  • Partner with account teams to understand customer vision and drive account-level strategies.
  • Collaborate with product and engineering to convey customer requirements and prioritize image builds.

Chainguard is the trusted source for open source, delivering hardened, secure, and production-ready builds of open source software. They are venture-backed by leading investors and serve Fortune 500 enterprises and global industry leaders.

AI Architect

ISC2
US

  • Define and document enterprise AI use cases, business value drivers, and target delivery models aligned with organizational goals.
  • Develop and maintain current-state and target-state AI architecture across the enterprise, including platforms, data flows, integration patterns, security controls, and governance.
  • Lead build-versus-buy evaluations for AI platforms and services, establish reusable architecture patterns, and guide proof-of-concept strategies.

ISC2 is the world's leading nonprofit member organization for cybersecurity professionals, dedicated to a safe and secure cyber world. With a globally recognized portfolio of certifications and a charitable arm, the organization fosters an inclusive culture built on integrity, advocacy, commitment, inclusion, and excellence.

Brazil

  • Evolve and maintain our Kubeflow, Feast, and Spark-on-Kubernetes ML infrastructure.
  • Design tools and APIs empowering teams to transition from centralized bottlenecks to self-service excellence.
  • Collaborate with Data Science teams to apply software engineering best practices to ML workflows.

Wellhub revolutionizes workplace wellness by connecting employees to partners for fitness, mindfulness, therapy, nutrition, and sleep in one subscription. Headquartered in NYC with team members across the globe, we value wellbeing, collaboration, and different perspectives.

$100,000–$150,000/yr
US

  • Design and operate enterprise-grade observability platforms across metrics, logs, traces, and events.
  • Build scalable monitoring stacks with Prometheus, Grafana, Loki, Tempo, OpenTelemetry, and Datadog.
  • Define SLOs, SLIs, error budgets, and alerting strategies to ensure system reliability.

Our partner is a technology company focused on building scalable observability platforms for distributed systems. They are an engineering-driven organization with a strong emphasis on automation, scalability, and developer experience.

United States

  • Lead engineering deployment, scaling, and operations of AI compute clusters with GPU fleets and bare metal environments.
  • Drive reliability, monitoring, automation, and incident response for AI infrastructure.
  • Collaborate with AI/ML, networking, and product teams to align infrastructure with business needs.

Our partner is a fast-growing cloud environment focused on building large-scale AI infrastructure. They seek a senior leader to manage engineering operations for advanced AI compute clusters.