Design, implement, and operate benchmark execution and evaluation harnesses for AI models and agentic workflows.
Develop evaluation methodologies that combine automated metrics with structured human subject matter expert judgment.
Produce defensible evaluation reports comparing candidate capabilities with current mission workflows, including documented limitations and failure modes.
OpenTeams helps enterprises and governments build AI they control, govern, and evolve themselves. Founded by NumPy and SciPy creator Travis Oliphant, the company is built by people with deep roots in the open-source ecosystem.
Lead a team of AI engineers, setting technical direction and quality standards while staying hands-on in code.
Own the architecture and end-to-end delivery of AI systems using LLMs, RAG, and agentic patterns.
Drive evaluation, monitoring, and continuous improvement loops to ensure production-grade AI capabilities.
Finom is a European tech startup building an all-in-one financial B2B platform for entrepreneurs, integrating banking, accounting, and invoicing. They are a well-funded company with over $346 million in total funding, maintaining a startup culture that values innovation, swift implementation, and employee impact.
You will own the reliability and quality bar for an AI copilot embedded in a trading platform used by sophisticated investors.
You will design and build evaluation systems that measure correctness, safety, latency, and regression risk across market analysis, portfolio/risk reasoning, and trading workflows.
You will develop and maintain benchmarks including curated golden sets, scenario suites, stress/adversarial cases, and continuously refreshed market-based test corpora.
Clear Street is a diversified financial services firm replacing legacy infrastructure in capital markets with a cloud-native clearing and custody system. Founded in 2018, the firm supports billions in daily trading volume and combines engineering talent with finance professionals to build a best-in-class experience.
Architect, build, and optimize high-performance production LLM systems while maintaining a strong personal technical presence on the team.
Spearhead strategic technological changes and champion code refactoring efforts to keep the core codebase cutting-edge and performant.
Lead technical story breakdowns, architectural design, and mentor engineers across the department.
Appian provides AI automation for mission-critical work, automating complex processes in large enterprises and governments. With over 25 years of experience, the company is known for its reliability and scale, and fosters an inclusive culture with employee-led affinity groups.
Build tooling for capturing and processing data from agents and humans at significant scale.
Solve hard problems around compute, orchestration, scaling, security, and reliability.
Help develop approaches for training, benchmarking, and evaluating AI agents.
Prolific builds human data infrastructure for AI development, connecting researchers with a global pool of participants to collect high-quality, ethically sourced behavioral data. They are a mission-driven company at the forefront of AI innovation, with a remote culture and a focus on impactful work.
Architect and own the technical roadmap for a secure local LLM platform deployed in company-controlled infrastructure.
Build modular inference layers with stable APIs, model routing, and production-grade serving optimizations.
Design and operate retrieval-augmented generation pipelines with permission-aware access and systematic evaluation.
Parallel Wireless is a U.S.-based pioneer in Open RAN innovation, transforming how mobile networks are built and powered. The company is a leader in software-centric, hardware-agnostic network solutions with a focus on reducing complexity and total cost of ownership.
Lead the development and optimization of machine learning models to detect and prevent AI security risks like prompt injection and jailbreaks.
Build reproducible training and evaluation pipelines on Reddit's ML platform, partnering with platform engineers to improve performance and reliability.
Set the technical vision and multi-quarter modeling roadmap, mentoring engineers and establishing best practices for responsible ML development.
Reddit is a community of communities, built on shared interests and authentic conversations, with 100,000+ active communities and 130 million daily active visitors. It is one of the internet's largest sources of information, fostering a culture of openness and trust.
Lead the Agent Tools, Agent Observability, and Runner Execution teams across frontend, backend, and AI engineering.
Partner with product and UX to turn ambiguous problems into shipped milestones and make prioritization tradeoffs explicit.
Contribute substantively to technical design for running agents safely and effectively at scale.
GitLab is the intelligent orchestration platform for DevSecOps, enabling organizations to increase developer productivity and accelerate digital transformation. With over 50 million registered users and more than 50% of the Fortune 100 trusting them, GitLab fosters a high-performance culture driven by values, continuous knowledge exchange, and AI integration.
Design and implement autonomous agents and multi-agent orchestration systems for complex, open-ended tasks.\n- Build and optimize production-grade LLM applications with a focus on reliability, observability, and low-latency performance.\n- Architect advanced RAG pipelines and vector database strategies to provide agents with accurate, real-time context.
Jobgether is an AI-powered job matching platform that connects candidates with hiring companies through objective evaluation. The company operates with a distributed, global-first team culture, emphasizing fairness and innovation in recruitment.
Work directly with leading AI labs and enterprises to define research goals and technical requirements.
Build data intelligence systems and implement ML pipelines for data curation, model training, and evaluation.
Develop LLM applications, including multi-agent systems, RAG workflows, and evaluation harnesses.
Our client is a venture-backed AI company building intelligent systems by combining human expertise with machine learning. With over $40 million in funding and a global expert network, they provide critical infrastructure for AI development.
Lead the design and development of the organization's agentic AI operating system, ensuring scalable and secure foundations.
Define engineering standards and operating models, partnering with product, data, and business teams to align with strategic priorities.
Oversee engineering teams in building reusable platform services, drive modernization, and monitor operations for continuous improvement.
Novartis is a global healthcare company focused on improving people's lives through innovative science and medicines. With a large, diverse team, they foster a culture of collaboration, learning, and inclusion, committed to delivering breakthrough treatments to patients worldwide.
Lead the AI/ML organization behind the immigration case management platform, including document understanding and extraction.
Manage and grow a team of ML engineers, setting technical direction on build-vs-buy for AI/ML capabilities.
Be accountable for cost, quality, and throughput of every model in production, with recognized depth in the field.
Envoy Global innovates in global immigration, combining a tech platform with holistic service to streamline immigration for employers and individuals. The company is scaling its AI/ML organization and seeks a Director to lead document understanding and automation.
Build and improve core components of the Agent Runtime, including intent routing, RAG, and multi-step agent workflows.
Design and optimize Tool Server / Tool Calling capabilities for agent execution and integration.
Develop evaluation datasets and harnesses to measure agent quality and reliability.
Binance is a leading global blockchain ecosystem behind the world's largest cryptocurrency exchange by trading volume and registered users. With over 320 million users in 100+ countries, Binance offers a dynamic, flat-structured environment focused on innovation and growth.
Design and ship ML systems for document understanding, extraction, classification, and scoring to power Copilot and Autopilot features.
Own the full lifecycle of ML solutions from problem framing to production monitoring, using user feedback and error analysis to drive continuous improvement.
Partner with product, engineering, and accounting experts to integrate ML naturally into user workflows and define quality metrics that reflect real value.
Pennylane is a fast-growing fintech building the financial operating system for French SMEs and accounting firms, with a vision to expand across Europe. The company has grown to 1,000 employees, raised €400 million from Sequoia, and maintains a remote-friendly culture with a 4.6/5 Glassdoor rating.
Design, build, and ship custom internal AI tooling, agents, and workflows for autonomy and research.
Integrate and extend third-party AI tools and evaluate new AI models with structured pilots.
Partner with cross-functional teams to prototype solutions and drive adoption of AI tools.
Waabi is a leader in Physical AI, founded by AI visionary Raquel Urtasun. The company is growing quickly with offices in Toronto, San Francisco, Dallas, and Pittsburgh, and seeks diverse, innovative candidates.
Design and maintain reliable, low-latency ML APIs to integrate Safety AI model outputs into cloud applications.
Build scalable data pipelines for continuous model iteration, backtesting, and online evaluation.
Optimize model artifacts for production and monitor rollout health, ensuring predictable failure modes.
Samsara builds a Connected Operations Cloud that helps physical operations use IoT data to improve safety, efficiency, and sustainability. Samsara is a recently public company with an employee-led remote culture and a long-term focus.
Own model strategy and selection using rigorous benchmarks and statistical analysis.
Design and maintain evaluation methodologies for AI systems, including offline sets and LLM-as-judge frameworks.
Develop classification, fine-tuned, and agentic AI models to improve accuracy, cost, and latency.
A production agentic AI platform that builds and deploys advanced machine learning systems. The team is collaborative and values innovation, offering a remote work environment with high autonomy.
Own Toptal's AI product strategy, deciding where agents and models belong across the marketplace and internal systems.
Establish the product operating model and metrics, driving decisions with evidence and user research.
Build and lead an exceptional product team, setting hiring bars and developing talent.
Toptal is a global network of top talent in business, design, and technology that enables companies to scale their teams on-demand. With $200+ million in annual revenue and team members around the globe, Toptal is the world's largest fully remote workforce, fostering innovation and fun.
Own the shared AI foundation used by product engineering teams, including model selection, routing, context management, and evaluation.
Design and ship agentic capabilities end to end, from proof-of-concept through production optimization and iterative improvement.
Establish evaluation infrastructure and practices to measure model and agent performance, ensuring quality and accuracy for financial decision-making.
Our partner is building a suite of financial planning and analysis capabilities powered by a shared AI foundation. They operate as a remote-first engineering team with a focus on autonomy, craftsmanship, and high-impact work.
Lead and mentor an engineering organization of senior, staff, and principal engineers, driving technical strategy and roadmap execution.
Embed AI-first operational strategy using modern tools like Claude Code to accelerate delivery and improve system resiliency.
Align cross-functionally with executive stakeholders to translate complex technical concepts into clear business opportunities.
Panopto is the most customer-centric learning technology company, empowering organizations to share knowledge through video. We are a global team of high-caliber engineers focused on elevating the craft and delivering impactful solutions.