Lead / Principal Data Engineer - DBT & Databricks

Key Responsibilities:

• Design, build, and maintain DBT models on Azure Databricks using Delta Lake, Unity Catalog, and Medallion Architecture principles.
• Deliver curated Gold-layer data domains to production standards in regulated enterprise environments.
• Leverage AI-assisted development tools such as Claude Code for model generation, refactoring, documentation, debugging, and engineering acceleration.

Required Skills & Qualifications:

• 5+ years of experience in Data Engineering with at least 2 years of hands-on DBT project experience.
• Strong SQL skills and solid Python programming experience with Azure Databricks, Delta Lake, and Medallion Architecture.
• Familiarity with DBT testing frameworks, data validation, and CI/CD deployment pipelines.

Preferred Skills:

• Experience with Databricks Genie environments or semantic layers for natural-language analytics.
• Experience within Insurance or Financial Services domains.
• Hands-on experience with PySpark, Databricks Workflows, or Airflow.