Similar Jobs

See all

Accountabilities:

  • Evaluate AI-generated coding interactions from beginning to end, assessing overall quality and effectiveness.
  • Provide clear, detailed, and opinionated written feedback on what works and what does not.
  • Help define and refine quality benchmarks for AI coding agents.

Requirements:

  • Senior, Staff, or Principal-level software engineering experience with strong Python expertise.
  • Hands-on experience with AI coding tools like OpenAI Codex, Claude Code, or Cursor.
  • Excellent critical thinking and communication skills with high standard for engineering quality.

Benefits:

  • Competitive hourly compensation ranging from $100 to $200.
  • Fully remote contract opportunity with flexible workload of 10-20 hours per week.
  • Opportunity to contribute to development of advanced AI coding technologies.

Undisclosed Company

The company focuses on improving AI coding agents through expert evaluation. It operates with a small, remote team and values technical excellence and critical thinking.

Apply for This Position