Senior Data Engineer

Data Pipeline Management:

• Build and optimize data pipelines and data infrastructure.
• Develop data quality suites and alerting functionality.
• Transform stage/raw layer data and define/manage data schemas.

Infrastructure and Tools:

• Utilizing Azure Databricks and Unity Catalog for data governance.
• Proficient in SQL, Python and comfortable with Git.
• Improve existing CI/CD pipeline(s) using Databricks Asset Bundles and GitHub Actions/Workflows.

Data Quality and Governance:

• Create and maintain data quality tests and consistency.
• Familiar with data governance practices, implementing or managing Unity Catalog.
• Improve existing alerting setups.