Data Engineer
Design, develop and optimize ETL pipelines using PySpark, Hive and Airflow for large-scale data processing. Build and maintain data lakes using Delta Lake, ensuring data reliability, quality, and integrity. Monitor, troubleshoot, and improve pipeline performance, scalability, and reliability.