AI Solutions Architect

Strategic & Commercial Responsibilities:

• Define and maintain the AI service catalog, offerings, tiers, packaging, and delivery methodology.
• Collaborate with sales and engagement teams to support pre-deal discovery and scoping.
• Use market intelligence to refine offerings and supply Product Marketing with details for positioning.

Technical & Delivery Responsibilities:

• Execute comprehensive system-level breakdowns of client AI stack components to formulate tailored testing approaches.
• Serve as an escalation point and subject-matter expert for Delivery on complex client engagements.
• Advance Testlio's proprietary AI testing framework combining code graders, LLM-as-a-judge, and human validation.

Why You'll Love This Job:

• Evaluate AI at a scale combining thousands of experts with model graders.
• Shape industry standards for AI testing at the frontier of QA.
• Gain high-visibility consulting with global market leaders.

What You Need to Succeed:

• Extensive hands-on experience in data science and machine learning.
• Deep familiarity with LLM evaluation frameworks and agentic architectures.
• Strong communication skills to bridge technical and business value.