Job Description
Swiftly is searching for a Data Engineer to join their high functioning team. This role will help scale our Retailer Platform that spans multiple technologies using Azure, Databricks, and API development. The platform is an end-to-end system that ingests retailers' raw data and serves it to multiple teams downstream, including the live, production mobile applications.
Responsibilities Include:
- Architect and implement scalable data pipelines using Databricks, Apache Spark, and Delta Lake
- Design and optimize data models and lakehouse architectures for performance and reliability
- Lead the development of ETL/ELT workflows in collaboration with data analysts, scientists, and stakeholders
- Ensure data quality, governance, and security best practices across the data ecosystem
- Partner with cross-functional teams to understand data needs and deliver effective solutions
- Other related duties as assigned
About Swiftly
Swiftly is a retail digital technology startup founded in 2018 and headquartered in the Bay Area that empowers regional and independent grocers.