Job Description
In this role, you will be expected to:
- Support the development and maintenance of data pipelines using Databricks, Spark, and similar technologies.
- Write and optimize SQL and Python scripts for data transformation, integration, and automation tasks.
- Develop automation scripts to populate metadata across Databricks tables.
You will also be expected to:
- Assist in building a proof-of-concept for an automated data dictionary.
- Contribute to prototyping an AI-powered knowledge agent.
- Collaborate with team members to enhance data quality.
About AccuWeather
AccuWeather, recognized as the most accurate and most used source of weather forecasts and warnings in the world, has saved over 12,000 lives.