Similar Jobs
See allBackend Engineer (AI Pro / Agent Infrastructure)
Binance
Asia
Python
Algorithms
LLM
Staff+ Software Engineer, AI
Jobgether
Americas
LLM APIs
Python
Agent Frameworks
Product Data Scientist — AI Evaluation & Quality
Finom
Europe
Python
SQL
Statistics
Senior ML Specialist
Jobgether
Brazil
Machine Learning
Python
Statistics
Research Data Scientist
Innodata
United States
Python
SQL
LLMs
Responsibilities:
- Design end-to-end LLM evaluation plans for business scenarios such as dialogue and financial trading.
- Build evaluation metric systems and rubrics to quantify model performance and drive improvement.
Requirements:
- Master's degree or above in Computer Science, AI, or related fields with a solid algorithmic foundation.
- Hands-on LLM evaluation experience at a large tech company with commercial deployment exposure.
Bonus Qualifications:
- Experience evaluating dialogue systems, AI Agents, or financial/trading LLMs.
- Familiarity with RLHF, reward models, or preference data-related work.
Why Binance:
- Shape the future with the world's leading blockchain ecosystem.
- Collaborate with world-class talent in a user-centric global organization with a flat structure.
Binance
Binance is a leading global blockchain ecosystem behind the world's largest cryptocurrency exchange by trading volume and registered users. Trusted by 300+ million people in 100+ countries, we offer a diverse range of digital-asset products and services.