Source Job

India

  • Build RL environments, agentic systems, LLM pipelines, and evaluation frameworks for real-world AI use cases.
  • Develop benchmarks and evaluation harnesses to assess model quality across accuracy, safety, latency, and cost.
  • Conduct fine-tuning and model experiments, deploy self-hosted models, and document reproducible methodologies.

AI/ML Reinforcement Learning Agentic Systems Model Evaluation

20 jobs similar to Applied AI Research Engineer

Jobs ranked by similarity.

India

  • Build reinforcement learning and agent environments for real customer and Frontier lab use cases, including task specifications, scoring, and evaluation.
  • Develop benchmarks and evaluation harnesses to measure model and data quality across accuracy, robustness, safety, latency, and cost.
  • Run fine-tuning, adapter, and other model experiments to evaluate how data and methods influence model behavior, and deploy local or self-hosted models for evaluation and inference.

Appen has been a leader in AI training data for over 30 years, specializing in human-generated data to train, fine-tune, and evaluate models across generative AI, LLMs, computer vision, and speech recognition. They support model development through an AI-assisted data annotation platform and a global crowd of over 1 million contributors in more than 200 countries, fostering a culture of innovation, collaboration, and humility over ego.

$180,000–$250,000/yr
Global

  • Work directly with leading AI labs and enterprises to define research goals and technical requirements.
  • Build data intelligence systems and implement ML pipelines for data curation, model training, and evaluation.
  • Develop LLM applications, including multi-agent systems, RAG workflows, and evaluation harnesses.

Our client is a venture-backed AI company building intelligent systems by combining human expertise with machine learning. With over $40 million in funding and a global expert network, they provide critical infrastructure for AI development.

Global

  • Develop and deploy cutting-edge AI/ML solutions to enhance the platform and improve student learning experiences.
  • Design, develop, and optimize LLM-powered agentic systems and APIs for real product use cases.
  • Collaborate with senior engineers and contribute to evaluation frameworks and MLOps pipelines.

Interview Kickstart specializes in interview preparation and career transitions into high-demand tech fields like AI, ML, and Data Science. Over 17,000 tech professionals have been guided by current and former hiring managers to land coveted positions at companies like Google and Amazon.

Global

  • Design and implement autonomous agents and multi-agent orchestration systems for complex, open-ended tasks.\n- Build and optimize production-grade LLM applications with a focus on reliability, observability, and low-latency performance.\n- Architect advanced RAG pipelines and vector database strategies to provide agents with accurate, real-time context.

Jobgether is an AI-powered job matching platform that connects candidates with hiring companies through objective evaluation. The company operates with a distributed, global-first team culture, emphasizing fairness and innovation in recruitment.

North America

  • Design and build production-grade AI agentic systems for web and chat experiences.
  • Architect agent workflows involving reasoning, tool use, retrieval, guardrails, and monitoring.
  • Build LLM evaluation systems and diagnose agent performance issues across prompts and tools.

Netomi is an agentic AI platform for enterprise customer experience, enabling automation for global brands. Backed by Y Combinator and Index Ventures, the company drives efficiency and higher quality experiences.

Global

  • Design agent architectures for planning, reasoning, tool use, and memory integration.
  • Improve reliability on long-running tasks with failure recovery and evaluation systems.
  • Build loops for agents to improve with real use, balancing quality, latency, and cost.

Adaption builds AI systems that evolve in real-time, making them flexible and personalized. They are a global-first team focused on talent density and collaboration.

$30,060–$54,108/yr
India

  • Architect and build scalable Generative AI and agentic AI applications from prototype to production.
  • Design LLM-powered workflows, prompt strategies, and multi-agent architectures using LangChain, LangGraph, or similar.
  • Collaborate directly with customers, product leaders, and engineering teams to translate business requirements into robust AI solutions.

Jobgether is an AI-powered job matching platform that connects candidates with hiring companies. They are a fast-moving technology environment with a focus on AI-driven recruitment processes and a culture of innovation and objectivity.

$130,000–$200,000/yr
US

  • Develop and improve core AI methods and systems for reliable AI agents across the full lifecycle.
  • Create novel approaches for simulation, evaluation, and optimization of agent behavior in production.
  • Turn research ideas into working prototypes and production-facing capabilities.

This is an early-stage AI infrastructure company focused on making AI agents reliable in production. The company values innovation and practical deployment, with a small team driving frontier AI research and product development.

$250,000–$300,000/yr
US Canada Unlimited PTO

  • Own the build out of new agents, skills, and platform capability for teams across TLDR.
  • Build and deploy agents end to end, from design through implementation, evals, and rollout to internal users.
  • Partner with stakeholders across sales, editorial, and people ops to find where an LLM belongs in their process.

TLDR runs the largest network of tech newsletters in the world, with over 8 million subscribers covering startups, software engineering, AI, and more. Our 31-person full-time team is bootstrapped, profitable, and on track for $35M in revenue this year, with a culture of owning functions rather than slices.

India

  • Architect and build scalable Generative AI and agentic AI applications from concept to production.
  • Design LLM-powered workflows, prompt strategies, and multi-agent solutions using LangChain and LangGraph.
  • Evaluate, fine-tune, and optimize LLMs, and own end-to-end ML and GenAI pipelines.

We are a partner company specializing in AI-powered recruitment, connecting top talent with innovative companies. We foster a collaborative, fast-paced environment with a focus on technical growth and professional development.

$129,211–$178,250/yr
Canada

  • Lead the design and delivery of AI/ML systems, defining architecture and establishing engineering standards for agentic workflows.
  • Build and maintain RAG pipelines, agentic workflows, and production system prompts with eval and observability.
  • Mentor engineers and take end-to-end ownership of features, including debugging and hardening production systems.

Robots and Pencils designs AI systems for a human world, pairing engineering with creativity to ship production-ready AI in 30 to 45 days. They are a company where every role contributes directly to integrating AI into enterprise operations, with a culture that values ownership, craft, and measurable impact.

France

  • Design, prototype, and build production-ready agentic workflows and LLM orchestration systems.
  • Move AI prototypes into scalable, low-latency microservices on Azure, ensuring production-grade integration.
  • Act as technical mentor for agent-focused engineering squads, driving AI quality and operational frameworks.

Shift Technology delivers AI agents that transform insurers' most critical work. With employees from over 50 countries, the company's culture is built on innovation, trust, and a drive to transform the insurance industry.

$76,200–$76,200/yr
Global 5w PTO

  • Build and deploy AI workflows and skills using AIVA
  • Integrate AI solutions with APIs, databases and enterprise systems
  • Rapidly build, test, demonstrate and refine solutions with clients

Williams Lea is the leading global provider of tech-enabled business and marketing services helping clients manage and transform processes. The company serves clients in 20 countries across four continents and has 15,000 employees worldwide.

Global

  • Design, develop, and deploy multi-agent AI systems for reasoning and task execution.
  • Implement RAG pipelines and optimize model serving for low-latency inference.
  • Build observability frameworks and apply security techniques for robust AI behavior.

AB InBev is a leading global brewer and top consumer product company with over 500 beer brands. The Growth Group is an exceptional team focused on digital transformation and scaling growth opportunities.

$160,000–$165,000/yr
US

  • Design and build enterprise-grade agentic AI platforms and LLM-powered applications.
  • Define reference architectures for RAG pipelines, multi-agent orchestration, and enterprise integrations.
  • Implement observability, guardrails, and responsible AI practices for production deployment.

Brillio is one of the fastest growing digital technology service providers, partnering with Fortune 1000 companies on digital adoption. It employs world-class professionals known as 'Brillians' and has earned Great Place to Work® certification repeatedly.

North America 3w PTO

  • Develop, configure, deploy, and optimize AI agents using Cresta's AI platform and tools.
  • Build AI agent integrations with external systems such as APIs, databases, and CRMs to ensure seamless workflow integration.
  • Collaborate with customers and internal stakeholders to gather technical requirements and translate business needs into AI agent solutions.

Cresta builds a unified AI platform that combines conversational AI agents, real-time human agent augmentation, and conversation intelligence to drive revenue and efficiency for customer experience channels. Born from Stanford AI Lab, the company has raised over $270 million from top investors and is led by AI industry veterans.

$150,000–$220,000/yr
US Unlimited PTO

  • Build production-grade agentic workflows to automate fan issue triage, seller risk monitoring, and marketplace optimization.
  • Coach non-technical teammates to use AI tools and create their own automations.
  • Own the full lifecycle of built solutions, from design to production, and scale successes across operations teams.

Gametime makes it easy for people to discover and access live experiences, with platforms supporting over 60,000 events across the US and Canada. They are a mid-sized company focused on reimagining the event ticket industry, with a culture that emphasizes inclusivity and innovation.

$105,000–$147,000/yr
US

  • Build and ship features of AI/ML and LLM-powered systems with guidance from senior engineers.
  • Implement and maintain AI/ML and AI agent pipelines from data ingestion through model deployment.
  • Contribute to LLM-powered features such as prompts, evaluations, retrieval, and tool integrations, while documenting experiments clearly.

Robots & Pencils designs AI systems for a human world, pairing engineering with creativity. Teams average fifteen-plus years of experience and value ownership, craft, direct feedback, and continuous learning.

India

  • Build AI agents and automations against specifications, including prompt development and knowledge grounding.
  • Own quality evaluation, knowledge curation, and monitoring of live AI workloads.
  • Maintain documentation and support production readiness, with a focus on scaling AI platforms.

Turnitin is a recognized innovator in global education, partnering with educators and institutions for over 25 years. With 16,000+ academic institutions and a remote-first culture, we are a global organization with team members in over 35 countries, unified by a shared desire to make a difference in education.

$225,000–$250,000/yr
US

  • Design and implement state-of-the-art ML models and training pipelines for robotics.
  • Develop efficient data/training strategies and evaluation frameworks for rapid experimentation.
  • Collaborate with engineering to optimize training infrastructure and deployment.

We're revolutionizing real-world automation by making robotic systems accessible to everyone. Our AI-powered platform brings software automation to physical spaces, and we're a small startup team working across the stack to solve customer problems.