Evaluate software engineering tasks for technical accuracy, realism, and reproducibility.
Investigate codebases, tests, and integration issues to identify technical weaknesses.
Provide clear, actionable feedback that directly improves AI training and evaluation workflows.
Jobgether is an AI-powered job platform that connects candidates to roles through objective, skill-based matching. It focuses on remote and freelance opportunities, with a data-driven recruitment process and a global candidate pool.
Review text or media samples based on provided project guidelines
Apply accurate labels and categorizations to diverse data sets
Evaluate AI-generated responses for clarity, safety, and factual accuracy
Terac is building the world's largest pool of vetted human experts for AI. Researchers, AI labs, and product teams use Terac to recruit, screen, and pay study participants across industries, languages, and skill sets.
Evaluate AI-generated code for correctness, efficiency, maintainability, and overall software quality.
Develop challenging programming problems, reference solutions, and comprehensive test cases.
Provide clear, detailed written technical feedback to support continuous AI model improvement.
Our client is a leading organization in the artificial intelligence industry, collaborating with top technology companies and AI research teams to advance next-generation AI systems. The company offers a remote, contract-based culture focused on evaluating AI-generated code and improving AI model performance alongside highly skilled technical professionals.
Design realistic software engineering challenges to assess AI models' coding abilities.
Build reference solutions and automated verification tests to ensure correctness.
Work independently on a fully remote, contract basis with flexible scheduling.
Jobgether is an AI-powered job matching platform that connects candidates with hiring companies through objective, AI-driven reviews. The company focuses on efficient hiring and shares top-fitting candidates directly with employers, with a culture emphasizing data privacy and fair evaluation.
Design and build automated evaluation pipelines for AI agents.
Develop testing frameworks for reasoning, multi-turn conversations, and adversarial scenarios.
Own the evaluation architecture and integrate observability tools in a fully remote team.
A company building production-grade AI agents and systems. They operate in a fully remote, globally distributed environment with a culture focused on innovation, autonomy, and continuous improvement.
Build and optimize RL infrastructure for large-scale training.
Improve efficiency across compute, memory, networking, and scheduling.
Design low-level optimizations, from kernels to runtime.
Prime Intellect builds the open superintelligence stack, providing full-stack infrastructure for frontier-scale AI post-training and deployment. The company has raised $150M from top investors and is mission-driven, focused on open-source AI and accelerating science.
Build inference systems powering RL research, scaling toward 1–3T parameter models on NVL72 clusters.
Optimize rollout throughput, multi-node MoE inference, and weight-update overhead for long-horizon agents.
Collaborate with model researchers on architecture choices balancing model quality and execution cost.
Prime Intellect is building the open superintelligence stack, unifying compute, environments, and deployment for frontier-scale AI post-training. Backed by $150M in funding, the team is mission-driven and hard-working, focused on accelerating open AI research.
Bring new open-source models into production with a focus on latency and throughput.
Optimize inference systems including batching, KV cache, speculative decoding, and quantization.
Design, deploy, and operate heterogeneous clusters across infrastructure vendors to improve reliability and cost efficiency.
They are an early-stage AI infrastructure startup making large language model inference faster and more cost-efficient. The small team focuses on low-level performance engineering and AI-assisted workflows, with a strong emphasis on technical fundamentals.
Design and execute test cases to validate AI-generated outputs.
Review and annotate datasets to improve machine learning model quality.
Analyze model predictions and report findings to enhance performance.
Jobgether is an AI-powered job matching platform that connects candidates with roles from partner companies. It uses algorithmic shortlisting to ensure applications are reviewed quickly and fairly, and it emphasizes data privacy and transparent hiring processes.
Annotate and label text, images, audio, or other content for AI training projects.
Evaluate AI-generated content for quality, relevance, accuracy, and overall usefulness.
Create, review, and test prompts to improve large language model performance.
AI Trainers Network is a global AI contributor network that shapes smarter and more human-centered AI through language and cultural expertise. It connects a diverse international community of independent contributors working on flexible, remote AI training projects.
Design realistic electrical engineering tasks based on electronics development, circuit analysis, and electrical systems design.
Create and validate electrical schematics, PCB layouts, and technical specifications for AI evaluation.
Review AI-generated designs for technical accuracy and establish reference solutions.
We create high-quality training and evaluation data for frontier AI models. We are a flexible, remote-first organization assembling a team of expert contractors to advance AI systems.
Own the client's GKE-based H200/GB200 training platform from the workload side, tuning GPU scheduling and networking.
Run, scale, and debug multi-node distributed training with PyTorch (FSDP, DeepSpeed, Megatron/NeMo-style) and Ray Train.
Design benchmarks, evals, and telemetry so platform and training changes are measured, not assumed.
Egen is a data-first engineering company that helps clients drive action and impact through data and insights using advanced platforms like Google Cloud and Salesforce. It is a fast-growing, entrepreneurial workplace focused on learning, solving tough problems, and continual innovation.
Own end-to-end performance optimization for production ML workloads, from bottleneck identification to rollout.
Diagnose ML performance bottlenecks across model execution, frameworks, runtimes, memory, and CPU/GPU utilization.
Design and implement improvements in inference execution, runtime behavior, batching, memory management, and precision.
Reddit is a community of communities, hosting open and authentic conversations across the internet. With over 100,000 active communities and approximately 130 million daily active users, it is one of the web's largest sources of information.
Design and build rigorous Terminal-Bench tasks to test LLM capabilities in multilingual software engineering and terminal workflows.
Create realistic task environments with datasets and files in your native language to measure multilingual robustness without English translation crutches.
Support reference solutions, write deterministic verifier scripts, and calibrate task difficulty across varied model tiers.
LILT provides AI-powered multilingual translation and language services for enterprises, governments, and AI developers. It is a global community of linguists and software engineers focused on innovation and human-verified AI solutions.
Own the evaluation framework for AI-assisted systems, building labeled ground truth datasets and designing statistically sound audit and sampling methodologies.
Measure model performance across releases, run drift and override reviews, and produce evidence packages supporting deployment decisions.
Work closely with data scientists and engineers to validate scoring and generative AI capabilities while maintaining independence from build roles.
DEFCON AI leverages artificial intelligence, mathematical optimization, and data analytics to help organizations optimize complex systems and manage disruptions. The company offers a fully remote, results-based environment with unlimited PTO, comprehensive benefits, and a focus on empowering employees to work independently.
Design complex legal tasks and reference answers for AI training.
Evaluate AI-generated legal responses for accuracy and reasoning.
Work across contracts, compliance, and legal research with high rigor.
Our partner is an AI training and evaluation company focused on improving legal AI models. The work is project-based, fully remote, and offers flexible scheduling with a collaborative environment.
Evaluate AI model responses across diverse topics and use cases against established quality standards.
Write, test, and refine system prompts to influence model behavior and performance.
Identify and document model failures and provide clear, actionable feedback to product teams.
This company specializes in evaluating and improving advanced AI systems through content evaluation and prompt engineering. It operates as a partner company managing applications for this role, focusing on quality and consistency in AI behavior.
Design and conduct realistic role-play scenarios for AI evaluation in travel, finance, and technical support.
Evaluate AI-generated audio conversations for accuracy, naturalness, and task completion.
Assess basic programming literacy and generate high-quality audio evaluation datasets.
Jobgether is an AI-powered job matching platform that connects candidates with hiring companies. This freelance AI trainer project focuses on evaluating conversational AI through realistic audio interactions, offering a flexible remote work environment for independent contractors.