Similar Jobs
See allData Platform Engineer
Block Labs
Kafka
SQL
PySpark
Data Engineer
Tieto Tech Consulting
Global
SQL
Python
PySpark
Senior Data Engineering Manager
YipitData
US
SQL
PySpark
Databricks
Software Engineer - Data Movement Platform
United States
Python
Scala
Go
Senior Software Engineer - Data Platform
Samsara
Canada
Go
Python
Apache Spark
Key Responsibilities:
- Design and build scalable data lake and processing pipelines with batch and streaming architectures.
- Operate real-time data streaming pipelines using Apache Kafka, and develop ETL/ELT pipelines with a focus on data quality.
- Manage SQL and NoSQL databases, and integrate data from internal and external sources via APIs.
Engineering Excellence:
- Apply software engineering best practices including version control, automated testing, CI/CD, and peer code review.
- Own operational health of data infrastructure, set up monitoring, and respond to incidents.
- Contribute to the data engineering community through knowledge sharing and mentoring.
Qualifications:
- At least 3 years of Data Engineering experience with hands-on Spark, Databricks, and Kafka.
- Proficiency in Python, and working knowledge of Scala or Java.
- Experience with cloud platforms (GCP, Azure, AWS) and Docker.
Why Join:
- Option to work remotely or from the office in a diverse, international environment.
- Your work will have immediate and visible impact on users.
- B2B cooperation model offered.
InPost
InPost is an e-commerce parcel delivery company that operates a network of Automated Parcel Machines (APMs) and pick-up points across nine European countries. Founded in 1999, the company employs thousands and fosters a diverse, international, and cross-functional culture with opportunities for growth and training.