AI Platform and Harness Engineer

What You'll Do:

• Design, build, and maintain enterprise AI platform capabilities supporting Large Language Models (LLMs), AI agents, RAG, and Generative AI applications.
• Develop reusable AI harnesses to automate testing, prompt evaluation, model benchmarking, and regression testing.
• Build AI evaluation frameworks to measure model accuracy, retrieval quality, latency, and cost.

What We're Looking For:

• Bachelor's degree in Computer Science or related field with 5+ years of software engineering experience.
• Strong programming in Python, experience with APIs, backend services, and cloud platforms (AWS, Azure, GCP).
• Experience with Docker, Kubernetes, CI/CD, and LLM technologies like RAG, embeddings, vector databases.

Nice to Have:

• Experience with AI orchestration frameworks like LangChain, LlamaIndex, or Semantic Kernel.
• Familiarity with LLMOps platforms, observability tools (LangSmith, Prometheus), and vector databases.
• Background in Responsible AI, AI governance, or federal government environments.

What’s In It for You?

• The opportunity to support high-visibility federal missions.
• A culture that values innovation, growth, and collaboration.
• Access to cutting-edge tools and technologies and comprehensive benefits.