Source Job

Global

  • Build LLM-powered software by designing prompt flows and orchestrations to ensure great performance with no false positives.
  • Architect and build a production-grade, testable, and maintainable AI-powered software stack.
  • Design experiments and evaluation frameworks for system performance testing at scale, conducting data analysis to draw conclusions.

Typescript Prompt Engineering LLM Orchestration Software Engineering Data Analysis

20 jobs similar to Software Engineer (LLM Prompting & Orchestration)

Jobs ranked by similarity.

$133,000–$184,000/yr
US 22w maternity 12w paternity

  • Contribute to internal AI platforms like Archimedes, Bosun, and easyRAG to help teams scale LLM-powered applications.
  • Build reusable platform capabilities such as APIs, SDKs, and templates for safe, high-quality AI tools.
  • Collaborate with Security, Risk, and Legal to implement guardrails for responsible AI development.

Chime is a financial technology company, not a bank, that offers user-friendly banking services to help everyday Americans achieve financial progress. They are a team of problem solvers and builders with a mission-driven culture, serving millions of members.

US

  • Design and build agentic AI systems to automate complex workflows across ICON's software platform.
  • Develop LLM-powered features using state-of-the-art foundation models and APIs.
  • Architect multi-agent pipelines, tool-use systems, and MCP integrations.

ICON is a construction technology company that develops advanced 3D printing and robotic systems for building homes and structures. The company fosters an innovative, inclusive, and diverse work environment with a focus on pushing the boundaries of construction technology.

Global

  • Own and build evaluation pipelines for AI workflows to define metrics, benchmarks, and acceptance criteria.
  • Drive continuous improvement of AI performance through quantitative analysis, prompting strategies, and workflow design.
  • Ensure reliability, monitoring, and stability of AI systems with dashboards, alerts, and failure detection.

HiPeople is an AI Hiring Platform that automates screening, interviews, assessments, and references for recruiting teams. They are a lean startup backed by leading investors, aiming to reach $10M ARR with fewer than 20 people, and work with brands like the NFL and Zapier.

Europe Unlimited PTO

  • Own and drive the quality, reliability, and evolution of AI systems in production across multiple products.
  • Design and orchestrate agentic AI workflows, tool-based systems, and multi-step LLM chains with clean tool contracts.
  • Manage production prompt systems, run A/B experiments, and monitor AI system metrics using Langfuse and other observability tools.

Ruby Labs is a leading tech company that creates and operates innovative consumer products across health, education, and entertainment. The company has a fast-growing, ambitious team with a high-performance culture.

$185,000–$200,000/yr
United States Unlimited PTO

  • Build and open-source LLM observability frameworks to monitor and evaluate AI systems.
  • Collaborate with the community to gather feedback and steer project direction.
  • Prototype new tools and educate developers through tutorials and documentation.

Arize AI is an AI observability and evaluation platform that helps teams monitor, troubleshoot, and optimize AI systems. They are a Series C company with over $135M in funding, serving 150+ enterprise customers like Booking.com and Uber.

AI Developer

Aphex
Global 4w PTO

  • Build and implement AI features by selecting the right model and approach for each use case.
  • Evaluate and monitor AI feature performance in production to ensure accuracy and reliability.
  • Improve and iterate on prompts and implementations based on how features behave in the wild.

Aphex is a construction execution platform that replaces traditional spreadsheets with collaborative tools for delivery teams. They are a remote-first company with a growing engineering team in the Philippines, serving major contractors on multi-billion dollar projects.

$210,000–$275,000/yr
US

  • Architect and build production systems across a multi-language stack including C#/.NET, Python, and TypeScript.
  • Design and drive adoption of offline and online evaluation frameworks for AI components, including test suites, golden datasets, and regression monitoring.
  • Partner with engineering leadership to surface systemic risks in AI features and lead architecture reviews for major initiatives.

RxSense is a healthcare technology company that provides platforms and solutions to improve the management and access of cost-effective pharmacy benefits. As a leader in SaaS technology for healthcare, they offer innovative solutions with integrated intelligence on a single enterprise platform.

US 24w maternity 24w paternity

  • Build the AI Platform Foundation by leading design and ownership of core infrastructure.
  • Standardize the AI Developer Path by architecting high-level abstractions and APIs.
  • Engineer AI Trust & Safety Systems through monitoring and quality assurance layers.

Smartsheet provides a collaborative work management platform. As a publicly traded company with thousands of employees, it fosters a culture of innovation and inclusion.

Global

  • Own AI product builds end to end, from concept through production, on client engagements.
  • Prototype fast with LLMs, then harden into production with data pipelines, integrations, and evals.
  • Serve as the primary technical contact for clients, giving clarity to both engineers and executives.

We're an AI services firm that helps companies figure out where and how to use AI. We've bootstrapped to roughly 40 people, worked with 30+ clients, and 4x'd revenue recently.

North America Canada

  • Design and build the agent execution harness, owning the orchestration layer that routes inputs, manages context, and handles multi-step agentic workflows at scale.
  • Ensure reliability, observability, and fault tolerance in production AI systems while optimizing for latency and cost.
  • Lead eval engineering and prompt infrastructure to maintain agent quality and drive data-informed decisions across model updates.

ServiceNow is an AI platform company that automates workflows and helps businesses reinvent themselves through its AI control tower. It serves 85% of the Fortune 500 and fosters an AI-native culture focused on innovation and talent.

Global

  • Design and maintain LLM-powered backend services using Python and FastAPI.
  • Implement retrieval-augmented generation (RAG) for structured and unstructured fleet data.
  • Optimize retrieval accuracy, latency, and hallucination rates through automated evaluation pipelines.

Datakrew revolutionizes EV fleet intelligence with IoT and AI solutions. They aim to serve one million EVs within 5 years and cultivate a mission-driven culture.

US Eastern Time Zone

  • Design, build and deploy production systems using software engineering, data science, and modern AI.
  • Work alongside Data Scientists and Engineers to operationalize models and build AI-powered products.
  • Deliver reliable, maintainable systems that create measurable business value.

M3 is a Japanese global leader providing technological and research solutions to the healthcare industry. The M3 Group operates in the US, Asia, and Europe with over 5.8 million physician members and is ranked in Forbes' Global 2000 list.

$190,000–$230,000/yr
Global

  • Identify and design AI-powered agentic architecture to automate repetitive tasks in creative and technical workflows.
  • Define end-to-end architecture for AI frameworks, integrating with DCC tools and building reusable components.
  • Drive adoption, create documentation, and report automation impact to studio leadership.

DreamWorks Animation is a leading producer of animated films and series, known for high-quality, award-winning content. They foster a growth-minded community of artists, technologists, and innovators who value transparency, trust, and collaboration.

Canada

  • Design, develop, and deploy production-grade AI-powered backend systems integrating LLMs and traditional ML models.
  • Integrate and optimize vector databases for RAG pipelines, and write clean, well-structured Python code.
  • Debug complex cross-layer issues and collaborate with product and engineering teams to deliver cohesive solutions.

We are a fast-growing product company integrating cutting-edge AI capabilities into our core offering to deliver exceptional value to customers. Our small, fast-moving team works on practical, real-world AI applications with high autonomy.

$120,000–$170,000/yr
US

  • Design, build, and maintain automated AI evaluation pipelines for production LLM applications.
  • Develop prompt engineering strategies and evaluate model performance using quantitative methods.
  • Analyze production AI behavior with Python, SQL, and statistical techniques to identify improvement opportunities.

GovWorx provides an AI-powered platform, CommsCoach, that supports 9-1-1 and emergency communications centers by automating quality assurance, training, and real-time call evaluation. The company is a growing technology team focused on public safety, collaborating across AI, engineering, product, and data science.

United States

  • Design and implement production-ready AI capabilities that improve reasoning, accuracy, and explainability.
  • Optimize autonomous agent workflows and Retrieval-Augmented Generation pipelines for performance.
  • Develop evaluation frameworks and benchmark datasets to measure AI effectiveness and drive continuous improvement.

LTS builds an AI-native engineering platform for modernizing mission-critical healthcare systems serving millions of Veterans. The engineering team is intentionally small, giving every engineer meaningful ownership and direct influence over product direction.

$120,000–$170,000/yr
US

  • Design, develop, and maintain LLM-powered applications and autonomous agents using Python and frameworks like LangGraph.
  • Build agentic workflows, implement prompt engineering strategies, and integrate LLM models across providers.
  • Develop observability tools, MCP Server components, and deploy cloud-native solutions on AWS.

NBCUniversal is one of the world's leading media and entertainment companies, creating and distributing content across film, television, and streaming, and operating theme parks. As a subsidiary of Comcast Corporation, the company champions an inclusive culture and strives to develop a talented workforce to serve communities.

US Unlimited PTO

  • Design and build agentic AI systems using frameworks like Mastra and n8n to power generative video platforms.
  • Work hands-on with creative and product teams to translate ideas into working AI architectures in real time.
  • Own observability, evaluation, and prompt management to ensure high-quality production performance.

Misfits & Machines is the innovation sister company of Marketing Architects, building transformative AI technologies to help marketers achieve remarkable growth. They are a fully remote team with industry-leading benefits and a culture focused on bold ideas and precision execution.

$153,000–$180,000/yr
US

  • Lead end-to-end development of advanced AI solutions including agentic systems, RAG pipelines, and multi-agent workflows.
  • Architect AI infrastructure with guardrails, access controls, and compliance protocols for ethical deployment.
  • Guide multi-disciplinary teams, setting technical playbook and best practices.

Nava is a consultancy and public benefit corporation that makes government services simple and effective. Since 2015, federal, state, and local agencies have trusted Nava to solve technology modernization challenges, and they maintain a collaborative, remote-friendly team environment.

  • Build and ship AI features end-to-end, from model to system to user experience.
  • Design and iterate on prompts, tools, memory, and agent workflows for real-world reliability.
  • Debug full-stack issues and optimize for latency, cost, and production performance.

A1 builds a proactive smart assistant for everyday users, bringing intelligence to conversations, errands, organizing, and workflows with minimal prompting. The team is small, world-class, and focuses on rapid iteration and shipping high-quality AI products.