Sr. Software Engineer II - AI Engineering

You Will:

• Design and build production-grade LLM-powered agents and workflows within Smartsheet, including architecture decisions on system design, data pipelines, and deployment strategies.
• Develop and optimize prompts, RAG pipelines, and agent reasoning patterns; build evaluation frameworks to measure accuracy, hallucination rates, and performance across model versions.
• Implement and manage end-to-end AI systems on cloud infrastructure (AWS, GCP, or Azure), including monitoring, optimization, and incident response.

You Have:

• 8+ years of software engineering experience, with at least 2 years working directly with LLMs in production.
• Deep, hands-on experience with prompt engineering and context engineering, understanding how model behavior changes with framing, structure, and input design.
• Strong working knowledge of RAG architectures: chunking strategies, embedding models, retrieval evaluation, and failure diagnosis.

What Success Looks Like:

• Delivered measurable, validated quality improvement on at least one SmartAssist agent across defined quality dimensions.
• Expanded evaluation coverage to close the most significant blind spots in the current framework.
• Established a repeatable quality improvement methodology the broader team can apply.

Current US Perks & Benefits:

• Employer subsidized medical/vision and dental coverage for full-time employees.
• 401k Match to help you save for your future (50% of your contribution up to the first 6% of your eligible pay).
• Flexible Time Away Program, plus Sick Time Off; US employees are automatically covered under Smartsheet-sponsored life insurance, short-term, and long-term disability plans.