Data Engineer
Benefits
4w PTO
Similar Jobs
See allSenior Staff Data Engineer
Shield AI
US
Databricks
PySpark
Spark SQL
Data Engineer
CampusWorks
US
Apache Spark
Python
SQL
Middle Data Engineer (Azure Databricks)
Miratech
Global
Azure Databricks
PySpark
SQL
Staff Data Engineer
Sonatype
Canada
Python
Scala
Java
Senior Data Engineer - Azure Databricks
Coforge
Latin America
Azure Databricks
DBT
Python
About the Role:
- Design, build, and optimize reliable, scalable data systems on the modern Databricks Lakehouse platform hosted in Microsoft Azure.
- Work closely with Data Analytics and Data Science teams to map business requirements into high-performance user-facing schemas.
What You'll Do:
- Ensure continuous data availability by monitoring, troubleshooting, and optimizing batch and real-time streaming pipelines.
- Deliver query-ready Gold-layer data marts and maintain data governance and asset discoverability.
- Deploy automated data quality test suites and expectations to ensure flawless data integrity.
Experience Required:
- Bachelor's degree in Computer Science, Engineering, or equivalent practical experience.
- Minimum 2+ years of experience designing, building, and enhancing high-performance ETL/ELT pipelines and data marts.
- Deep technical experience with Databricks, Unity Catalog, Delta Live Tables, and CI/CD pipelines.
Trupanion
Trupanion is a leading provider of medical insurance for cats and dogs in North America, helping pet owners budget and care for their pets. The company offers a collaborative, casual, and pet-friendly environment where everyone is encouraged to be themselves.