Job Description
As a Data Engineer, you will design and implement robust ETL/ELT pipelines to ingest, transform, and store data from diverse structured and unstructured sources. You will use Azure Data Factory, Databricks, and related tools to manage orchestration, transformation, and pipeline deployment. You will also develop scalable data lake and data warehouse solutions using ADLS Gen2, Delta Lake, and Azure SQL DB. Apply best practices for data pipeline performance tuning, resource optimization, and parallel processing using Apache Spark and PySpark. You will automate data workflows and validation processes and partner with analysts, data scientists, engineers, and business stakeholders to understand requirements and deliver impactful data products. Finally you will ensure adherence to data governance, quality, privacy, and compliance standards.
About Technology, Information and Media
This role is for one of our clients in the Technology, Information and Media industry.