Similar Jobs
See allSenior Data Engineering Analyst - Affirmative Vacancy for Women
Experian
Brazil
PySpark
Python
AWS
Data Engineer
Jobgether
Brazil
Apache Spark
Apache Kafka
Python
Senior Data Engineer
Capital Technology Group
US
Python
PySpark
SQL
Lead Data Platform Engineer (Brazil Based)
Experian
Brazil
Java
Scala
Apache Spark
Senior Data Engineer
Oportun
Mexico
Python
PySpark
SQL
Responsibilities:
- Develop and maintain scalable, efficient, and resilient data pipelines using PySpark and distributed processing frameworks.
- Modernize legacy data processes by migrating them to scalable distributed-processing architectures.
- Design and implement data processing solutions within AWS environments, leveraging appropriate cloud services.
Qualifications:
- Bachelor's degree or equivalent higher education.
- Solid professional experience with PySpark and distributed data processing frameworks.
- Strong knowledge of Apache Airflow, Apache Spark, and Hadoop where applicable; proficiency in Python and SQL.
Why Join:
- Opportunity to work on large-scale data platforms and modern cloud technologies.
- Exposure to complex data engineering challenges and continuous learning.
- Inclusive environment focused on diversity, collaboration, and professional growth.
Jobgether
Jobgether is an AI-powered job matching platform that connects candidates with hiring companies. It focuses on efficiency and fairness in recruitment, promoting diversity and inclusion in the workplace.