Job Description
We are looking for a Data Engineer that has experience in building data products using Databricks and related technologies. This position will be Full-time and Remote position.
As a Data Engineer, you will play a crucial role in building cloud-based data lake and analytics architectures using AWS and Databricks and is proficient in Python programming for data processing and automation. Design, develop, and maintain data lakes and data pipelines on AWS using ETL frameworks and Databricks.
Integrate and transform large-scale data from multiple heterogeneous sources into a centralized data lake environment. Implement and manage Delta Lake architecture using Databricks Delta or Apache Hudi. Develop end-to-end data workflows using PySpark, Databricks Notebooks, and Python scripts for ingestion, transformation, and enrichment. Design and develop data warehouses and data marts for analytical workloads using Snowflake, Redshift, or similar systems. Design and evaluate data models (Star, Snowflake, Flattened) for analytical and transactional systems.
About CAI
CAI is a global technology services firm with over 8,500 associates worldwide and a yearly revenue of $1 billion+.