Utilize Automatic Prompt Generation (APG) tools to create baseline prompts for complex parent-child template clusters.
Monitor shadowbot runs and run prompt versions against gold data to measure autorater quality and accuracy metrics.
Manually draft, test, and refine prompts to navigate complex template architectures and handle edge cases.
Welo Data provides AI services specializing in data validation and LLM evaluation. They operate as a freelance-focused organization with a remote workforce, emphasizing technical agility and quality assurance.
Design, build, and maintain automated AI evaluation pipelines for production LLM applications.
Develop prompt engineering strategies and evaluate model performance using quantitative methods.
Analyze production AI behavior with Python, SQL, and statistical techniques to identify improvement opportunities.
GovWorx provides an AI-powered platform, CommsCoach, that supports 9-1-1 and emergency communications centers by automating quality assurance, training, and real-time call evaluation. The company is a growing technology team focused on public safety, collaborating across AI, engineering, product, and data science.
Design and iterate complex system prompts and chain-of-thought structures for consumer AI experiences.
Partner with engineers and product managers to optimize prompt specifications for latency and cost.
Develop evaluation frameworks and playbooks to guardrail LLM outputs against bias and hallucination.
BOLD is a global company that creates digital products to help people build resumes, cover letters, and CVs, empowering job seekers in 180 countries. They are an established organization that values diversity and inclusion, with a culture of growth and professional fulfillment.
Build and maintain MCP servers, tool definitions, and context management capabilities.
Design and implement intent evaluation, classification, and routing workflows.
Integrate Anthropic and OpenAI models into production environments.
Applaudo designs, builds, and scales AI-powered solutions that create real business impact. They foster a high-performance culture grounded in values such as empowerment, collaboration, and transparency.
Design and maintain LLM-powered backend services using Python and FastAPI.
Implement retrieval-augmented generation (RAG) for structured and unstructured fleet data.
Optimize retrieval accuracy, latency, and hallucination rates through automated evaluation pipelines.
Datakrew revolutionizes EV fleet intelligence with IoT and AI solutions. They aim to serve one million EVs within 5 years and cultivate a mission-driven culture.
Design, build, test, and iterate on prompts and prompt chains for production LLM workflows across client delivery and internal automation.
Implement evaluation harnesses, guardrails, and regression tests to ensure measurable and stable output quality.
Integrate LLM components with business systems via APIs, retrieval pipelines, and structured outputs.
Caravel is an award-winning NetSuite and Salesforce partner and part of BPM LLP, a Top-40 accounting and advisory firm. With 20+ years of experience and 1,000+ implementations, we are a fully remote team helping businesses across North America with honest technology solutions.
Own the design and defense of frontier model evaluations across reasoning, coding, agents, tool use, and multi-modal.
Build benchmark packages with expert-verified ground truth, multi-model headroom results, and rigorous QC.
Recruit, calibrate, and review a pool of subject-matter experts in coding, agentic/tool-use, and STEM/reasoning.
Anyone AI measures frontier model capability through expert-verified evaluation packages. The company operates as a remote team with a focus on rigorous benchmarking and lab collaboration.
Evaluate AI quality across the advisor stack, including pre-call briefs, in-call guidance, and post-call outputs.
Iterate inside ORA by refining prompts, updating knowledge base entries, and tweaking skills to close the loop on issues.
Surface trends and drive continuous improvement by tagging conversations, logging issues, and recommending prioritized improvements.
HighLevel is an AI-powered business operating system that gives agencies, entrepreneurs and SMBs the infrastructure to build, automate and scale. With over 2,000 team members across 10+ countries, HighLevel operates as a global, remote-first organization built for speed and ownership.
Design, develop, and deploy production-ready generative AI and machine learning applications.
Collaborate with cross-functional teams to integrate AI capabilities into business systems.
Apply prompt engineering, retrieval-augmented generation, and evaluation strategies to optimize AI performance.
The company is a technology firm specializing in AI transformation initiatives. It fosters a collaborative culture centered on learning, innovation, and professional development.
Design and build production-ready AI agents that allow users to query enterprise data using natural language.
Develop Text-to-SQL pipelines using LLMs, ensuring generated queries are accurate, secure, and performant.
Collaborate with cross-functional teams to integrate AI into scalable platforms and improve accuracy through testing.
This role is listed on behalf of a partner company, which manages all applications and next steps. The company uses an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements.
Build the AI Platform Foundation by leading design and ownership of core infrastructure.
Standardize the AI Developer Path by architecting high-level abstractions and APIs.
Engineer AI Trust & Safety Systems through monitoring and quality assurance layers.
Smartsheet provides a collaborative work management platform. As a publicly traded company with thousands of employees, it fosters a culture of innovation and inclusion.
Lead the design, development, and deployment of enterprise-scale AI and data solutions using AWS and Snowflake.
Architect and implement large language models and agentic AI workflows for business automation and decision support.
Collaborate with cross-functional teams to ensure solutions meet regulatory, security, and compliance requirements in financial services.
U.S. Financial Technology operates the largest and most advanced mortgage securitization platform globally, supporting the Uniform Mortgage-Backed Security of Fannie Mae and Freddie Mac. The company supports 70% of the mortgage-backed securities market and offers a full lifecycle of services with a focus on cloud-based technology and innovation.
Design and implement production-ready AI capabilities that improve reasoning, accuracy, and explainability.
Optimize autonomous agent workflows and Retrieval-Augmented Generation pipelines for performance.
Develop evaluation frameworks and benchmark datasets to measure AI effectiveness and drive continuous improvement.
LTS builds an AI-native engineering platform for modernizing mission-critical healthcare systems serving millions of Veterans. The engineering team is intentionally small, giving every engineer meaningful ownership and direct influence over product direction.
Architect and build end-to-end GenAI applications using Python, LangChain, and LlamaIndex on Google Cloud.
Develop advanced RAG pipelines and Semantic Search systems for production-level accuracy.
Optimize LLM and Embedding fine-tuning while applying MLOps best practices for scalability.
Egen is a fast-growing and entrepreneurial company with a data-first mindset, using advanced technology platforms like Google Cloud and Salesforce to drive client impact through data and insights. We are dedicated to learning and innovation, with a culture that values engineering expertise and solving tough problems.
Review and refine AI-generated outputs related to corporate law, contracts, regulatory compliance, and legal documentation
Evaluate the practicality and accuracy of AI recommendations for legal risk, transactional work, and compliance issues
Create and develop real-world scenarios and case studies from your legal experience
10x Team connects top freelance professionals with leading AI labs to accelerate innovation in artificial intelligence. They seek seasoned corporate lawyers based in the EU or UK to train AI systems focused on corporate law, contract analysis, and compliance.
Lead complex AI engineering workstreams across multiple business areas and stakeholder groups.
Design and build AI-powered applications using LLMs, agents, and modern architectures.
Establish best practices for prompt engineering, API integrations, and code quality.
The partner company focuses on designing and delivering advanced AI solutions that help organizations transform business processes and create measurable value. It offers a collaborative and inclusive culture with opportunities for career growth and international mobility.
Develop and integrate applications with Large Language Models and enterprise services.
Design and implement scalable APIs using front-end and server-side technologies.
Collaborate with cross-functional teams and optimize AI applications utilizing cloud infrastructure and DevOps.
Derex Technologies Inc specializes in providing IT consulting, staffing solutions, and software services. Founded in 1996, the company delivers customized IT talent solutions to clients across North America.
Design and develop production-grade LLM applications using Python and FastAPI.
Build and optimize retrieval-augmented generation pipelines with LangChain or similar frameworks.
Implement prompt engineering strategies and evaluate AI systems for accuracy and performance.
Our partner is an innovative engineering team building advanced AI solutions that transform how businesses interact with complex operational data. They offer a fully remote work environment with opportunities to work on cutting-edge technology and collaborate with global teams.
Design and deploy state-of-the-art GenAI solutions including RAG pipelines, LLM orchestration, and AI agents.
Lead high-impact, client-facing engagements and oversee junior consultants.
Work hands-on with Databricks, LangChain, and models like GPT, LLaMA, and Claude.
Lovelytics helps some of the most complex enterprises modernize their data and put AI to work. The company has grown from 85 to 500+ people across the Americas, maintaining a technically excellent, low-ego culture.
You will build AI-assisted tools, workflow automations, agents, prompts, and integrations to reduce manual effort and improve productivity.
You will partner with business stakeholders to understand high-friction workflows and deliver fit-for-purpose AI solutions.
You will implement engineering controls for data handling, access management, prompt safety, and output validation.
Shield AI is a venture-backed defense-tech company that develops intelligent systems, including Hivemind autonomy software and V-BAT and X-BAT aircraft, to protect service members and civilians. With offices across the U.S., Europe, the Middle East, and Asia-Pacific, the company's technology supports operations worldwide.