Source Job

United States

  • Architect and build large-scale ML systems spanning data, training, evaluation, inference, and deployment.
  • Implement evaluation pipelines covering performance, robustness, safety, and bias.
  • Own production deployment including GPU optimization, memory efficiency, latency reduction, and scaling policies.

PyTorch Deep Learning GPU Optimization

20 jobs similar to Principal Machine Learning Engineer, Artificial Intelligence (AI)

Jobs ranked by similarity.

US

  • Own end-to-end ML system execution including data pipelines, training workflows, evaluation systems, inference architecture, and deployment.
  • Fine-tune and adapt models using state-of-the-art methods such as LoRA, QLoRA, SFT, DPO, and distillation.
  • Architect scalable inference systems, balance latency, cost, and reliability, and deploy production-grade ML solutions.

Gina's Tech Jobs is a recruiting and staffing company that helps firms hire technical talent. They are a small agency focused on IT roles, fostering a high-trust, collaborative environment.

  • Optimize production LLM serving with vLLM and SGLang to maximize throughput and minimize latency through batching and quantization.
  • Profile training runs to find bottlenecks and resolve them with attention implementations like FlashAttention on H200 and GB200 hardware.
  • Deploy and operate multiple models on shared GPU clusters with autoscaling, bin-packing, and efficient handling of mixed workloads.

Egen is a fast-growing technology company with a data-first mindset, partnering with clients on Google Cloud and Salesforce to drive action through data and insights. We are a team of dedicated engineers who thrive on solving tough problems and continually innovate to achieve fast, effective results.

US

  • Own end-to-end Machine Learning (ML) system execution including data pipelines, training, and deployment.
  • Fine-tune and adapt models using state-of-the-art methods like LoRA and DPO.
  • Architect scalable inference systems and collaborate closely with application engineering.

This company develops advanced production-grade machine learning systems. The team is small and high-trust, with a culture of ownership and pragmatism.

US

  • Architect and maintain production high-traffic LLM serving systems.
  • Optimize throughput, latency, and cost for leading open-source LLMs.
  • Debug and optimize major inference engines like SGLang, vLLM, or TensorRT using PyTorch and CUDA.

We are building decentralized and confidential machine learning infrastructure to enable user-owned AI. Our team is focused on highly scalable and efficient infrastructure for open-source AI at a global scale, with a culture that values innovation and performance.

EMEA

  • Build and operate production-grade model serving infrastructure using vLLM, TGI, or Triton frameworks.
  • Design and implement auto-scaling, multi-model architectures, and intelligent request routing for ML inference.
  • Optimize GPU utilization, memory efficiency, and observability to ensure low-latency, cost-effective systems.

They are a distributed cloud infrastructure startup building AI-native cloud services with GPU-powered compute. The company is well-funded, fast-scaling, and operates in a remote-first environment with a focus on sustainability and decentralization.

US

  • Build and improve ML components across data, training, evaluation, and inference.
  • Implement evaluation and testing to understand model behavior.
  • Debug model issues, performance problems, and production incidents.

This company builds core ML components for large-scale production systems. They emphasize real-world learning, iteration, and collaboration with senior engineers.

India

  • Research and implement state-of-the-art techniques to accelerate AI inference: quantization, sparsity, distillation, speculative decoding, and caching.
  • Partner closely with hardware and compiler teams to ensure algorithmic improvements translate to real gains on custom silicon.
  • Build profiling tools and comprehensive benchmarking frameworks to measure model quality and efficiency.

EnCharge AI is building the next generation AI platform using novel in-memory-computing architecture. The team consists of experienced AI researchers, silicon & systems engineers, and architects backed by leading investors.

$130,000–$170,000/yr
US

  • Design and implement AI capabilities for intelligent data characterization and decision support.
  • Evaluate, optimize, and deploy open-weight foundation models for resource-constrained edge environments.
  • Develop efficient inference pipelines and implement RAG, semantic search, and model optimization techniques.

Expression provides data fusion, analytics, AI/ML, software engineering, and spectrum management solutions to the U.S. Department of Defense and national security community. Founded in 1997 and headquartered in Washington DC, the company was ranked #1 on Washington Technology's 2018 Fast 50 and is a Top 20 Big Data Solutions Provider, fostering a collaborative culture with opportunities for growth.

US

  • Own the technical design and delivery of subsystems in a high-throughput, low-latency inference platform.
  • Develop robust API layers and SDKs that abstract complex distributed inference orchestration.
  • Build and harden a multi-tenant control plane for metering, rate limiting, and tenant isolation.

Stack develops revolutionary AI and autonomous systems to enhance safety and efficiency in trucking. The team has decades of experience deploying real-world systems and is committed to inclusion, entrepreneurship, and innovation.

US Unlimited PTO

  • Design and maintain scalable ML infrastructure including data pipelines, training workflows, and model deployment systems.
  • Own end-to-end ML lifecycle operations, ensuring reliable delivery of models into production at scale.
  • Implement monitoring, telemetry, and feedback loops for ML models running across large-scale device fleets.

Our partner company develops ML systems for connected hardware products used by customers worldwide. They operate in a fast-paced, product-driven environment with a collaborative and technically ambitious culture focused on real-world ML impact.

$161,000–$273,000/yr
US Unlimited PTO 12w maternity 12w paternity

  • Lead the design and operation of production machine learning systems for batch and online use cases with a focus on reliability and scalability.
  • Build and improve ML lifecycle infrastructure including training pipelines, inference workflows, monitoring, and automation.
  • Partner with cross-functional teams to translate business problems into ML solutions and guide prototypes to robust production systems.

Included Health is a healthcare company delivering integrated virtual care and navigation, aiming to raise the standard of healthcare for everyone. They are a remote-first organization offering comprehensive benefits and fostering a culture of inclusion.

$220,000–$280,000/yr
US Unlimited PTO

  • Build ML infrastructure for low-latency model deployment, distributed inference pipelines, and real-time telemetry.
  • Scale ranking systems by moving models from experimentation to production, optimizing latency and cost trade-offs.
  • Implement model CI/CD for automated versioning, canary releases, hot-swappable container rollouts, and zero-downtime rollbacks.

Sequen provides an integrated platform that pairs cutting-edge frontier ranking models with infrastructure to run them in production at sub-10ms latency and enterprise scale. They are a small, highly technical, early-stage team focused on turning recent AI advances into production-grade systems.

Australia

  • Design, build, and ship ML models that power content generation and quality eval scoring for Canva's generated element and template library.
  • Own the full ML lifecycle — from data pipelines and training through to deployment, monitoring, and iteration.
  • Partner with Content Engine, CORE AI Research, AI Media, and Discovery teams to align ML work with the broader content strategy.

Canva is redefining how the world experiences design with its intuitive design platform. We serve hundreds of millions of users globally and foster a culture of flexibility, inclusion, and innovation.

$140,000–$170,000/yr
US

  • Design, build, and deploy AI/ML solutions from prototype to production for client business problems.
  • Apply generative AI and LLMs, establishing MLOps best practices including CI/CD and model monitoring.
  • Serve as a trusted technical advisor, translating ambiguous problems into well-scoped solutions and presenting to stakeholders.

DevIQ builds modern cloud and data solutions for mid-market companies focused on energy reduction, healthcare, education, and smart cities. The company offers competitive benefits, a strong team culture, and opportunities to work on end-to-end solutions with multi-disciplinary teams.

UK Netherlands

  • Design and build systems that improve the efficiency of ML training and inference workloads.
  • Develop tooling that helps ML engineers debug, profile, optimize, and monitor model performance.
  • Partner with ML researchers and product teams to identify bottlenecks and drive performance improvements.

Reddit is a community of communities built on shared interests, passion, and trust, hosting the most open and authentic conversations on the internet. With over 100,000 active communities and approximately 126 million daily active users, Reddit is one of the internet's largest sources of information.

US

  • Develop and operate production-ready AI and machine learning systems for enterprise-scale products.
  • Build and optimize LLM-powered applications, RAG pipelines, and intelligent agents.
  • Implement software engineering best practices for AI development including CI/CD and testing.

Our partner is building enterprise-grade AI solutions that deliver measurable business impact. They offer a remote-friendly work environment with a collaborative engineering culture focused on innovation, quality, and continuous learning.

$150,000–$180,000/yr
US

  • Develop and improve NLP systems and language model-powered experiences.
  • Fine-tune and optimize language models for domain-specific use cases and build evaluation frameworks.
  • Deploy and maintain production-grade ML systems on GPU infrastructure with a focus on scalability and safety.

BetterHelp removes barriers to therapy and makes mental health care accessible globally. Founded in 2013, it is now the world's largest online therapy service with over 30,000 licensed therapists, and it invests deeply in employee well-being and professional development.

United States 6w PTO

  • Train, fine-tune, and optimize large language models powering AI companion and conversational systems at scale.
  • Design and maintain agentic frameworks and LLM orchestration systems, including reasoning loops and chat orchestration.
  • Research state-of-the-art NLP techniques and implement alignment methods such as RLHF and DPO to improve model quality.

We are an AI-powered job matching platform that connects candidates with hiring companies through objective, fair review processes. As a globally distributed, innovation-focused company, we foster a collaborative engineering culture with continuous learning opportunities.

$90,000–$150,000/yr
United States

  • Design and deliver production AI and agentic systems across document intelligence, workflow automation, and copilots.
  • Own architecture decisions for LLM-based systems, including retrieval, tool use, orchestration, memory, and evaluation.
  • Manage evals and observability for production AI, ensuring system accuracy and detecting regressions.

Maxwell is a mortgage technology and fulfillment company on a mission to make lending simpler, faster, and more accessible. It is a remote-first team that takes craft seriously and moves with intention, building a cutting-edge AI company in mortgage technology.

United States

  • Lead technical discovery with foundation model labs, frontier AI teams, and large enterprises to understand model objectives and constraints.
  • Design end-to-end solutions across the post-training stack including SFT data curation, RLHF/DPO pipelines, custom benchmarks, and LLM-as-judge systems.
  • Author technical proposals, run workshops and POCs, and serve as ongoing technical advisor during delivery.

Innodata is a global data engineering company focused on enabling responsible AI advancement through data, evaluation frameworks, and human expertise. With a 36+ year legacy, they provide high-quality data solutions to foundation model labs, hyperscalers, and enterprise AI teams.