Similar Jobs
See allSenior Data Software Engineer
Jobgether
Brazil
PySpark
Spark SQL
Delta Lake
Senior Data Engineer
Lumin Digital
US
Databricks
Python
SQL
Senior Data Analyst (Databricks and PySpark)
Partner Company
Brazil
Python
SQL
Databricks
Senior DataOps Engineer
Redcare Pharmacy
Europe
Azure
Databricks
Apache Spark
Databricks Data Architect
Devoteam
Global
Databricks
Apache Spark
Delta Lake
Accountabilities:
- Design, develop, and implement data engineering solutions using the Databricks ecosystem with Lakehouse and Medallion architectures.
- Build and manage data pipelines with Databricks, PySpark, Spark SQL, and Delta Lake, including CDC and Structured Streaming.
- Act as a technical reference, mentoring team members and establishing engineering best practices.
Requirements:
- Extensive experience delivering production-grade data engineering solutions with Databricks and advanced proficiency in PySpark, Spark SQL, and Delta Lake.
- Hands-on knowledge of Delta Live Tables, Liquid Clustering, Auto Loader, and Unity Catalog for governance and security.
- Strong expertise in Spark performance tuning, CI/CD, and Azure Data Factory integration.
Benefits:
- Comprehensive healthcare coverage including medical and dental insurance.
- Financial support through meal vouchers, life insurance, and an employee referral program.
- Wellness benefits including mental health support, fitness membership, and extended parental leave.