Head of Engineering (Agentic AI)

You will own the architecture, development, and continuous improvement of Sully.ai's NLP models powering the Receptionist and Assistant agents. Working cross‑functionally with Product, Clinical, and Reliability Engineering, you’ll translate clinical workflows into robust conversational AI solutions that meet HIPAA‑level security and compliance requirements. Design end‑to‑end pipelines for intent detection, entity extraction, and dialogue management using Hugging Face Transformers. Adapt state‑of‑the‑art architectures (e.g., BERT, GPT) on domain‑specific data to optimize receptionist and assistant workflows, leveraging prompt engineering and RAG techniques. Establish benchmarks (F1‑score, ROUGE, MMLU) and A/B test protocols to measure dialogue accuracy, user satisfaction, and model latency. Containerize models with Docker, serve via FastAPI, and orchestrate on Kubernetes for high availability and observability. Build CI/CD pipelines for model training, testing, and versioning; integrate monitoring and alerting for data drift and performance regressions. Partner with Product and Clinical teams to curate training data, refine user flows, and onboard new engineers into our NLP practice.