Similar Jobs

See all

Accountabilities:

  • Design, develop, and implement data engineering solutions using the Databricks ecosystem with Lakehouse and Medallion architectures.
  • Build and manage data pipelines with Databricks, PySpark, Spark SQL, and Delta Lake, including CDC and Structured Streaming.
  • Act as a technical reference, mentoring team members and establishing engineering best practices.

Requirements:

  • Extensive experience delivering production-grade data engineering solutions with Databricks and advanced proficiency in PySpark, Spark SQL, and Delta Lake.
  • Hands-on knowledge of Delta Live Tables, Liquid Clustering, Auto Loader, and Unity Catalog for governance and security.
  • Strong expertise in Spark performance tuning, CI/CD, and Azure Data Factory integration.

Benefits:

  • Comprehensive healthcare coverage including medical and dental insurance.
  • Financial support through meal vouchers, life insurance, and an employee referral program.
  • Wellness benefits including mental health support, fitness membership, and extended parental leave.
Apply for This Position