Responsibilities:
- Design and optimize data notebooks/pipelines in Azure Synapse Analytics for scalability and performance.
- Implement data quality checks and validation processes to maintain accuracy and consistency.
- Monitor ETL jobs, diagnose issues, and ensure pipeline reliability with comprehensive documentation.
Required Skills:
- Proven experience in ETL data engineering using Python (PySpark) for data extraction, transformation, and loading.
- Proficiency in Azure Synapse Analytics resources including Notebooks, Pipelines, Linked Services, and Azure Key Vault.
- Ability to write complex SQL queries, optimize performance, and work with SparkSQL and MS SQL.
Company Benefits:
- Competitive salary and bonuses, including performance-based salary increases.
- Generous paid-time-off policy and flexible working hours for remote work.
- Continuing education, training, conferences, and company-sponsored coursework and certifications.
Bluelight
Bluelight is a leading software consultancy that designs and develops innovative technology to enhance users' lives. The company fosters a collaborative environment, has a presence across the United States and Central/South America, and is in an exciting phase of expansion.