Azure Data Engineer

As an Azure Data Engineer, you will design, build, and maintain scalable data pipelines and analytics solutions on the Microsoft Azure platform. In this role, you will work with cutting-edge technologies such as Azure Databricks, Azure Synapse Analytics pipelines, and Microsoft Fabric, empowering the business with timely, accurate data. Key responsibilities include designing and developing data pipelines using Azure tools to ingest, transform, and load data from various sources into data lakes and warehouses. You will utilize Azure Databricks (Spark) for big data processing, optimizing PySpark/Scala jobs for cleansing and aggregating large datasets. Additionally, you'll build and maintain data warehouses on Azure Synapse or Microsoft Fabric, designing data models for efficient analytics and reporting. The role also involves optimizing and monitoring workloads, tuning queries, and collaborating with data analysts and scientists to provide clean, well-structured datasets. You will implement data quality and security measures, ensuring data governance standards are maintained. Staying current with the latest Azure data services and bringing innovative ideas to optimize the data platform is also expected.