Source Job

• Plan, execute, and oversee inspection and testing of Bobtails services to confirm quality.
• Analyze and investigate service complaints or reported quality issues to ensure resolution.
• Monitor risk-management procedures and maintain problem logs for identifying and reporting issues.

Bobtail is dedicated to increasing happiness by eliminating inefficiencies in the supply chain. They envision a supply chain without friction, fraud, waste, and abuse where companies succeed based on the value they create. Bobtail values teams over individuals and encourages experimentation and iteration to constantly improve.

• Execute functional, regression, and integration tests across our Web and API layers to ensure every release meets our high standards.
• Act as a "detective" by identifying, documenting, and tracking defects in Jira, providing developers with the clear logs and reproduction steps they need to succeed.
• Work alongside senior mentors to use AI-powered tools (like GitHub Copilot and Gemini) to generate test cases and write your first automated test scripts.

TrueML is a mission-driven financial software company that aims to create better customer experiences for distressed borrowers. The TrueML team includes inspired data scientists, financial services industry experts and customer experience fanatics building technology.

• Develop, create, execute and maintain test cases, test plans, test scripts and other QA documentation.
• Performing thorough functional, regression and exploratory testing of mx51’s products.
• Identifying, recording and communicating bugs to developers and product managers.

Mx51 is a payments-as-a-service solution for banks, non-bank acquirers, and other merchant service providers. They are building a payment platform that allows merchants to accept payments in-store, in-app and online, whilst consolidating all their data on a real-time business management dashboard.

• Evaluate AI-generated responses for accuracy, grammar, and cultural relevance.
• Identify issues and provide refined, high-quality rewritten responses.
• Create natural prompts and responses in Spanish to improve conversational datasets.

Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems. They're building smarter, more human AI with a diverse community in 100+ countries.

• Working in tandem with a programmer on exploratory testing of new language functionality.
• Searching for and localizing bugs, submitting the results to our issue tracker.
• Taking part in planning, including creating plans for testing the corresponding changes.

JetBrains strives to make the most effective developer tools on earth. By automating routine checks and corrections, their tools speed up production, freeing developers to grow, discover, and create.

• Completing AI training tasks such as analyzing, editing, and writing in Mandarin
• Judging the performance of AI in performing Mandarin prompts
• Improving cutting-edge AI models

Prolific is building the biggest pool of quality human data in the world and is not just another player in the AI space. Over 35,000 AI developers, researchers, and organizations use Prolific to gather data from paid study participants with a wide variety of experiences, knowledge, and skills.

• Plan, coordinate and execute test and quality-related activities within a cross-functional team.
• Design and develop rich and usable test frameworks and test suites for targeted automated coverage.
• Be an enthusiastic advocate for quality and an evangelist for team test culture and practice.

Entrust shapes the future of identity-centric security solutions with a comprehensive portfolio. Headquartered in Minnesota, they serve over 150 countries with cutting-edge, scalable technologies, and are driven by curiosity, dedication, and innovation.

• Creation and editing of English subtitles.
• Subtitle localization using AI tools.
• Management of freelance proofreaders (communication, deadlines).

HOLYWATER is a tech company creating entertainment products at the intersection of human creativity and artificial intelligence. They build AI-native platforms redefining storytelling and empowering anyone to become a creator, and have over 60 million app downloads.

• Evaluate AI-generated Japanese speech and text for linguistic accuracy, naturalness, and educational quality.
• Assess learner speech and writing across proficiency levels from CEFR Pre-A1 through B2+.
• Apply expert judgment to identify learner errors, unnatural phrasing, and pedagogical gaps.

Alignerr partners with leading AI labs to build expert-driven data pipelines that improve how models reason, learn, and communicate. They work with domain specialists around the world to evaluate and refine AI systems in areas where precision, pedagogy, and human judgment matter most.

• Review, score, and improve AI-generated responses.
• Evaluate prompts and responses across a wide range of topics.
• Perform QA checks on other annotators’ work and provide feedback.

RWS provides language services and technology solutions. They embrace DEI and promote equal opportunity, committed to providing employees with a work environment free of discrimination and harassment.

• Review short, pre-segmented datasets.
• Evaluate model-generated replies based on Tone or Fluency .
• Read a user prompt and two model replies, then rate each using a five-point scale.

CrowdGen, by Appen, focuses on AI response evaluation. They are looking for native Javanese speakers to contribute to a multilingual AI response evaluation project where you review large language model outputs.

• Determine the best test strategy, whether manual or automated.
• Write clear test plans, test cases, and bug reports.
• Lead testing for small to medium features and mentor junior QA team members.

BetterHelp's mission is to remove traditional barriers to therapy and make mental health care more accessible. Founded in 2013, they are the world’s largest online therapy service with over 30,000 licensed therapist and millions of users across the globe, with a focus on employee well-being and growth.

• Work with product managers to ensure product quality.
• Identify areas for improved testing and automation.
• Build and maintain test frameworks and pipelines.

Acquia empowers brands to create digital customer experiences. They have open source Drupal at its core, enabling teams to deploy digital products. They are headquartered in the U.S., certified as a Great Place to Work in India, and recognized as a top software company.

• Listen to short audio clips in Russian and evaluate them using a defined rubric.
• Accurately identify target accents from provided audio samples.
• Compare multiple recordings and assess which one sounds more natural in relation to the target accent.

Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems. We’re building smarter, more human AI with a diverse community in 100+ countries.

• Conducting market assessment and analysis to identify localization needs.
• Managing the localization budget, including forecasting expenses.
• Supporting quality standards and creating quality control procedures.

Welltech is a global company with Ukrainian roots that aims to help people start and stay well for life. They have five hubs across Cyprus, Ukraine, Poland, Spain, and the UK with a remote-friendly team of 700+ professionals that is scaling rapidly.

• Evaluate AI-generated French speech and text for linguistic accuracy, naturalness, and educational quality.
• Assess learner speech and writing across proficiency levels from CEFR Pre-A1 through B2+.
• Apply expert judgment to identify learner errors, unnatural phrasing, and pedagogical gaps.

Alignerr partners with leading AI labs to build expert-driven data pipelines. They improve how models reason, learn, and communicate by working with domain specialists to evaluate and refine AI systems where precision, pedagogy, and human judgment matter most.

• Own the creation, execution, and maintenance of manual test cases based on functional and technical requirements.
• Validate end-to-end campaign and tracking workflows, including user interactions, lead capture flows, and data attribution mechanisms.
• Analyze campaign and analytics metrics to identify tracking gaps, configuration errors, or data inconsistencies.

Blue Coding specializes in hiring excellent developers and amazing people from all over Latin America. They have helped cutting-edge companies in the United States and Canada build great development teams and develop great products for the past 11 years with a team of over 150 engineers, project managers, QA, UX/UI designers, and many more is distributed in more than 10 countries across the Americas.

• Working with the Country Localisation Lead to create Canva’s voice across all parts of the Canva product in Italian.
• Translating key content and managing the relationship with our localisation partners for Italian.
• Developing/updating a style guide and glossary, reviewing and evaluating translations, and providing cultural insights and guidance.

Canva is a design platform that empowers everyone to create and publish anything. They collaborate with talented contractors and freelancers from all over the world to help them achieve their crazy big goals.

• Lead the testing strategy for our new AI-first Forms Platform.
• Build evaluation harnesses to measure the accuracy of auto-mapping AI models against golden datasets.
• Minimize defect escape rates and ensure complex government forms are rendered perfectly.

Filevine provides cloud-based workflow tools for the legal sector. They are known for intuitive technology and a team of passionate professionals, and they are ranked as one of the most innovative and fastest-growing technology companies in the country.

• Developing test strategies based on requirements and schedule.
• Designing and executing test cases using system specifications.
• Testing new features and performing regression testing.

Devexperts has been consulting and developing for the financial industry for nearly two decades. They solve complex technological challenges facing the most well-respected financial institutions worldwide and foster self-improvement and actively seek out-of-the-box ideas.