Source Job

• Set program quality goals, roadmap, and operating rhythms.
• Manage a team of Analysts and Coordinators; hire, coach, and run performance cycles.
• Co-own client governance with Ops; align on scope, priorities, and changes.

Welo Data provides high-quality, ethically sourced, relevant, diverse, and scalable datasets to technology companies to supercharge their AI models. As a Welocalize brand, they bring together a global community of over 500,000 AI training and domain experts.

Serve as the embedded QA engineer on two pods (Jump’s cross-functional teams), collaborating with product managers to evaluate AI outputs, run exploratory and regression testing, and unblock engineers and PMs. Learn and track AI/ML quality signals, including golden datasets, prompt/regression suites, and metrics. Build dashboards for quality KPIs (defect escape rate, flake rate, regression coverage, MTTD/MTTR, AI eval scores) and drive continuous improvement.

Jump’s mission is to empower financial advisors and their clients to thrive in the age of AI.

Distill customer feedback into a cohesive product vision. Own end-to-end feature development by defining product requirements and managing development & testing. Maintain a perspective on the evolving generative AI landscape to feed product evolution.

ServiceNow stands as a global market leader, bringing innovative AI-enhanced technology to over 8,100 customers, including 85% of the Fortune 500®.

• Design complex LLM prompts that accurately represent real customer journeys and service interactions.
• Partner with Field Engineers to transform raw data into structured, high-quality tasks for model training.
• Annotate and review tasks to ensure strict quality standards and alignment with expected customer outcomes.

Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models.

This role validates Veeva AI Agents through evaluation. You will define strategies for new AI Agents. The role involves analysis of model behaviors to identify defects.

Veeva Systems is a mission-driven organization and pioneer in industry cloud, helping life sciences companies bring therapies to patients faster.

• Participate in round-table style discussions about AI tools, including capabilities, weaknesses, cultural alignment, prompt behavior, and model differences.
• Share real examples of how you use AI - coding, writing, document creation, design support, idea generation, manga/comic development, translation, etc.
• Evaluate model outputs and provide detailed feedback on issues such as: overly formal or informal tone, incorrect cultural references or mismatched context.

With 27+ years of experience, Welo Data stands as a global leader in high-quality datasets and AI services.