Similar Jobs
See allCX Knowledge Base & Conversational AI Manager
Ashley Digital
US
Data Analysis
Knowledge Management
Cross-functional Collaboration
AI Evaluation Engineer
GovWorx
US
Python
SQL
Machine Learning
AI Platform Lead
Jerry.ai
US
AI
LLMs
SQL
AI Builder
Best10
Global
LLM APIs
Prompt Engineering
Python
AI Builder
Best10
LLMs
Prompt Engineering
Full Stack Development
Key Responsibilities:
- Evaluate AI quality across the advisor stack, including pre-call briefs, in-call guidance, and post-call outputs.
- Iterate inside ORA by refining prompts, updating knowledge base entries, and tweaking skills.
- Surface trends and drive continuous improvement by tagging conversations and logging issues.
Requirements:
- 2+ years of experience in Quality Assurance, Customer Support, or AI evaluation.
- Working understanding of LLM behavior, prompt design, and conversational AI patterns.
- Comfort reading code and making minor edits; strong written communication and attention to detail.
Preferred Qualifications:
- Hands-on experience with AI development platforms such as Claude or Cursor.
- Familiarity with SQL, RAG, vector databases, or APIs.
- Background in customer success, support, or sales enablement.
HighLevel
HighLevel is an AI-powered business operating system that gives agencies, entrepreneurs and SMBs the infrastructure to build, automate and scale. With over 2,000 team members across 10+ countries, HighLevel operates as a global, remote-first organization built for speed and ownership.