Job Description
We are looking for a talented and motivated person to act as a Data Developer, integrating with our team and contributing to the construction of scalable and intelligent solutions for large volumes of data. Responsibilities include designing, developing, and maintaining scalable and robust data pipelines, creating ingestion, transformation, and data modeling solutions using Databricks, Spark/PySpark, Cloudera, and Azure Data Factory (ADF). Guarantee the quality, integrity and usability of data throughout the pipeline. Implement CI/CD pipelines focused on ETL processes. Design and maintain Data Lake and Data Warehouse solutions, with the application of good data governance practices. Apply FinOps concepts for optimizing costs related to data processing in the cloud. Develop and document workflows, processes and data architectures. Perform technical troubleshooting of pipelines and data infrastructure. Work with concepts and structures such as Bronze, Silver and Gold layers, Star Schema, Delta Tables, Delta Sharing and analytical tables. Collaborate with technical and business teams to orchestrate solutions aligned with the company's objectives. Manage the technical roadmap of data projects, considering dependencies, trade-offs and change management.
About CI&T
CI&T is a company that unites human expertise with AI to create scalable tech solutions, partnering with over 1,000 clients over 30 years.