Similar Jobs

See all

What you'll do:

  • Participate in a structured training track to develop expertise in AI benchmarking, profiling, and performance tuning.
  • Build and scale benchmarking infrastructure for evaluating AI systems in enterprise settings.
  • Design agent evaluation pipelines that measure reasoning, accuracy, alignment, and user outcomes.

What you'll bring:

  • 3–10+ years of experience as a Software Engineer in backend, systems, or infrastructure roles.
  • Strong foundation in Python or similar backend languages like Go, Java, C#, or Node.js.
  • Hands-on experience in building APIs and cloud-native architectures (AWS, GCP, or Azure; Kubernetes a plus).

Why This Role Matters:

  • Agents are not APIs — they reason, adapt, and learn, and this role defines how we measure success.
  • You will design the KPIs of the AI-native enterprise, bringing rigor to systems that reason and structure to software that thinks.
  • Shape how intelligence is measured in SaaS 2.0.

DevRev

DevRev is building Computer, an AI teammate that unifies data, tools, and workflows into a single AI-ready platform, giving employees real-time insights and proactive suggestions. Backed by Khosla Ventures and Mayfield with over $150M raised, the company is trusted by global companies across industries and fosters a culture of innovation and collaboration.

Apply for This Position