AI Transcription Evaluator

Neon

Remote regions

Global

Benefits

Similar Jobs

See all

What You'll Do:

  • Evaluate LLM-generated transcriptions.
  • Generate high-quality human annotations to correct model-generated transcripts.
  • Apply consistent annotations by following guidelines.

Who You Are:

  • Hold a Bachelor’s degree or equivalent experience.
  • Are a native speaker or have ILR 5/primary fluency in English.
  • Have experience using large language models (LLMs).

Nice-to-Have Specialties:

  • Prior experience with audio data annotation, RLHF, or other data annotation work.
  • Experience comparing multiple outputs and making fine-grained qualitative judgments.

Neon

Neon partners with leading AI teams to improve the quality, usefulness, and reliability of audio-based AI systems. Projects focus on evaluating and improving transcriptions of audio recordings generated by large language models (LLMs).

Apply for This Position