Source Job

Europe

  • Design large-scale data processing systems and own projects end-to-end.
  • Analyze and improve the efficiency, scalability, and stability of applications.
  • Identify and remove unnecessary complexity in data pipelines and systems.

Java Python Apache Spark BigQuery Airflow

20 jobs similar to Big Data Engineer IV

Jobs ranked by similarity.

Europe

  • Design, build, and maintain scalable data lake solutions and processing pipelines handling large volumes of data.
  • Develop distributed data processing applications using Apache Spark on Databricks and build real-time streaming pipelines with Apache Kafka.
  • Apply software engineering best practices to data pipelines including CI/CD, automated testing, and peer code review.

InPost is an e-commerce parcel delivery company that operates a network of Automated Parcel Machines (APMs) and pick-up points across nine European countries. Founded in 1999, the company employs thousands and fosters a diverse, international, and cross-functional culture with opportunities for growth and training.

Spain

  • Design, develop, and maintain ETL and data transformation processes.
  • Implement and support Spark-based data pipelines and contribute to data integration initiatives.
  • Collaborate in Agile teams and participate in DevOps practices and CI/CD processes.

Talan is an international advisory group specializing in innovation and transformation through technology, with 5,000 employees and an annual turnover of 600M€. They offer services in consulting, data & technology, cloud & application services, and service centers of excellence.

$164,200–$229,900/yr
United States

  • Build and improve scalable, fault-tolerant, self-serve data infrastructure technologies to support ML and analytics workflows.
  • Own the Data Movement Platform for batch and stream data processing, and invest in building new infrastructure for Spark, Flink, and Airflow.
  • Collaborate with teammates on on-call responsibilities and monitoring/alerting to improve reliability, scalability, latency, and efficiency.

Reddit is a community of communities built on shared interests, passion, and trust, hosting the most open and authentic conversations on the internet. With over 100,000 active communities and approximately 126 million daily active unique visitors, Reddit is one of the internet's largest sources of information.

$185,000–$220,000/yr
US Unlimited PTO

  • Design, build, and maintain robust, scalable batch and streaming data processing, storage, and integration pipelines.
  • Take full ownership of building features from the ground up, mentoring and leading your team to deliver the right solutions.
  • Partner with data scientists and engineers to create semantic data models and integrate applications across Shift5 componentry.

Shift5 is building the data platform for onboard operational technology (OT), delivering cybersecurity, predictive maintenance, and compliance capabilities for defense and commercial fleets. They are a growing company with a team-based environment, committed to building an inclusive culture and embracing diversity.

Europe

  • Design and deliver end-to-end data platforms for analytics, BI, machine learning and AI-ready data products
  • Build and optimise scalable ETL/ELT pipelines with Databricks, Spark/PySpark, SQL and Python
  • Apply data quality, governance and security standards across the platform and mentor engineers

Tieto Tech Consulting provides design-led, data-centric, and AI-powered digital engineering & consulting services to enterprises worldwide. They focus on diversity, equity, and inclusion, fostering an inspiring workplace with a global team.

Poland

  • Gain deep understanding of ad technology and industry standards like OpenRTB, MRAID, VAST.
  • Analyze and improve end-to-end ad workflows, reproducing problematic cases and proposing improvements.
  • Lead implementation of architectural solutions and provide hands-on technical leadership.

RTB House is a global marketing technology company providing AI-powered ad-buying solutions. The company processes over 20 million requests per second and fosters a culture of technical excellence and ownership.

India

  • Design and implement scalable, low-latency real-time data streaming architectures and end-to-end data pipelines for high-volume systems.
  • Develop clean, maintainable, and efficient code using technologies such as Go, Python, TypeScript/Node.js, Scala, and SQL.
  • Build and optimize complex data processing workflows handling structured and unstructured data sources.

Our partner is looking for a Sr. Data Engineer - Data Analytics based in India. The company operates in a global, remote-first environment with a multicultural team spanning 45+ nationalities, focusing on work-life balance and employee well-being.

UK

  • Build and maintain data pipelines for analytics, ML, and product applications.
  • Design scalable data infrastructure with a focus on quality and observability.
  • Collaborate with cross-functional teams to understand data needs and implement solutions.

Prolific builds human data infrastructure to power the next wave of AI innovation. They are a remote-first company focused on ethical data collection and mission-driven culture.

Ireland

  • Build and maintain BigQuery data models using Dataform, following medallion architecture patterns.
  • Build robust Python data pipelines with testing, linting, and CI/CD integration.
  • Support Data Scientists in moving work from notebook to production pipeline.

Kitman Labs is a performance intelligence company disrupting the sports industry by using data to unlock athlete potential. Their team of top data scientists, performance scientists, and engineers serves over 2000 teams in 50 leagues globally, fostering an innovative and world-class culture.

Brazil

  • Design, develop, and maintain scalable ETL/ELT data pipelines to ingest, transform, and load data into data warehouses.
  • Implement and monitor data quality frameworks, ensuring accuracy, consistency, and reliability across datasets.
  • Collaborate with data scientists, analysts, and business stakeholders to deliver effective data solutions.

Jobgether is an AI-powered job matching platform that connects candidates with hiring companies. They focus on efficient and fair candidate evaluation through technology.

Europe

  • Build and scale data infrastructure powering targeting, identity, and measurement capabilities.
  • Optimize core ETL/ELT pipelines and ensure operational reliability with documented SLAs.
  • Implement privacy-compliant data methodologies meeting GDPR/CCPA standards.

Kargo creates powerful moments of connection between brands and consumers to build businesses. With 600+ employees and offices across the US, UK, Australia, and Ireland, they take a creative science approach to deliver unique ad experiences across premium platforms.

US Canada

  • Build, maintain, and scale data pipelines integrating internal and external data into the warehouse.
  • Partner with internal stakeholders and engineering teams to understand analysis needs and improve data logging.
  • Participate in architectural decisions and evangelize data engineering best practices.

OXIO is the world’s first telecom-as-a-service platform, democratizing telecom for brands and enterprises to own proprietary mobile networks. The company is a rapidly growing startup with a diverse and inclusive team.

Europe

  • Design, build, and maintain backend services, REST APIs, databases, and big data pipelines that power customer-facing insights and analytics.
  • Implement and maintain near-real-time stream-based data processing pipelines in collaboration with batch-oriented data refresh workflows.
  • Scale data processing and insights generation pipelines to handle growing volumes of activity data while managing infrastructure costs.

Backstory helps companies understand the state of their revenue business by answering questions that span customer interactions, sales activity, pipeline health, and deal execution. Headquartered in San Francisco, CA, Backstory is backed by Y Combinator and top investors, and is listed in the top 20 percent of Inc 5000 companies.

India

  • Design, build, and stabilize Databricks-based data pipelines from ingestion to reporting.
  • Optimize existing pipelines for performance, scalability, cost efficiency, and reliability.
  • Collaborate with cross-functional teams to enhance data platform stability and business value.

The company is a partner organization leading a high-impact data transformation initiative. It operates in a fast-paced, technically challenging environment with a collaborative, impact-driven culture.

$86,870–$112,420/yr
Canada

  • Architect Spark-driven workflows at scale and design data platforms as products for internal teams.
  • Develop and maintain end-to-end data pipelines and backend ingestion workflows across multiple sources.
  • Champion Samsara's cultural principles and mentor junior team members to drive data-driven decisions.

Samsara is the pioneer of the Connected Operations Cloud, enabling organizations to harness IoT data for actionable insights to improve safety, efficiency, and sustainability. As a recently public company, it fosters a culture of rapid career development, ownership, and high performance.

$145,600–$200,200/yr
US Unlimited PTO

  • Design and build scalable components for high-throughput data ingestion and processing.
  • Develop systems for storing and serving batch data, and contribute to API services and event-driven applications.
  • Optimize data storage and retrieval for high throughput, security, and ease of access, and mentor peers.

Phaidra builds AI-powered control systems for industrial facilities, using reinforcement learning to optimize automation. The company is fully remote with a global team of around 100+ employees, emphasizing a culture of transparency, collaboration, ownership, and empathy.

$92,144–$119,246/yr
Canada

  • Design, build, and operate high-scale data ingestion and replication systems from production data stores into the data lakehouse.
  • Build and maintain reliable, scalable data platform infrastructure capable of handling petabytes of data across analytics, AI, and operational use cases.
  • Develop internal libraries, APIs, frameworks, and tooling in languages such as Go and Python to help teams move and access data safely.

Samsara is the pioneer of the Connected Operations Cloud, enabling organizations that depend on physical operations to harness IoT data for actionable insights. As a publicly traded company, Samsara fosters a growth-oriented culture and serves industries that represent over 40% of global GDP.

Global

  • Own data end to end, from raw source to analysis that drives decisions for growth, finance, and product.
  • Build and operate pipelines in BigQuery with Airflow, model in dbt, and deliver analysis in Hex.
  • Work AI-first, using modern tooling to move faster while staying accountable for production output.

Supabase provides a complete backend platform including Database, Auth, Storage, Edge Functions, Realtime, and Vector Search, built by developers for developers. With 280+ team members across 55+ countries and $500M raised, they are open-source-first and globally distributed.

India

  • Design, build, and scale cloud-based data platforms that support critical business insights and operations.
  • Collaborate with cross-functional teams to extract, load, and transform data using cloud-native principles.
  • Mentor engineers and drive architectural direction through code reviews, testing, and documentation.

Credit Acceptance is a leading used car finance company in the United States. It has a world-class culture shaped by dedicated Team Members and a shared drive to succeed.

Canada

  • Design and optimize large-scale ETL pipelines using Python, PySpark, SQL, DBT, and cloud-based data platforms.
  • Define technical vision and architecture for data integration solutions, ensuring scalability and reliability.
  • Lead technical initiatives, mentor engineers, and collaborate with cross-functional teams to deliver high-quality data solutions.

Jobgether uses AI-powered matching to connect candidates with job opportunities at partner companies. They focus on efficient, objective recruitment processes for a fast-growing remote-first environment.