Source Job

Global

  • Design and implement real-time streaming data pipelines for high-volume event data.
  • Develop and operate distributed data processing systems using technologies such as Apache Flink, Apache Kafka, Apache Druid.
  • Build scalable ingestion pipelines capable of handling millions of events per second.

SQL Java Python AWS Kafka

20 jobs similar to Senior Data Engineer – Real-Time Streaming

Jobs ranked by similarity.

Egypt

  • Build CDC pipelines and real-time streaming (Kafka/Flink)
  • Design and maintain data models (raw to staging to core)
  • Implement observability, data transformations and quality checks

Jobgether is a platform that connects job seekers with companies. They use an AI-powered matching process to ensure applications are reviewed quickly, objectively, and fairly.

Global Unlimited PTO

  • Design Scalable Data Architecture: Build modern, cloud-native data platforms (AWS, Snowflake, Databricks) supporting batch and streaming use cases.
  • Develop Efficient Data Pipelines & Models: Automate ETL/ELT workflows, optimise data models, and enable self-serve analytics and AI.
  • End-to-End Data Ownership: Manage ingestion, storage, processing, and delivery of structured and unstructured data.

Trustonic provides smartphone locking technology, enabling global access to devices and digital finance. They partner with mobile carriers, retailers, and financiers across 30+ countries, powering device financing solutions. They celebrate diversity and aim to do the right thing for each other, the community, and the planet.

Europe Unlimited PTO

  • Lead the design and delivery of complex data engineering projects.
  • Design and develop core components of our data platform.
  • Mentor engineers on the team, elevating their skills and promoting best practices in data engineering.

MoonPay is a unified payments platform for digital currency, making it easy for anyone to buy, sell, swap, and pay in digital currencies. They are trusted by over 30 million customers and over 500 ecosystem partners, driving mainstream crypto adoption worldwide.

Europe

  • Design and implement scalable, high-performing data pipelines and optimize our data architecture.
  • Build and deploy cloud-native solutions leveraging Azure Data Services, Databricks and other Big Data technologies.
  • Collaborate across teams to understand and support their data needs while ensuring the data architecture supports ongoing and future initiatives.

Redcare Pharmacy is Europe’s No.1 e-pharmacy, powered by passionate teams and cutting-edge innovation. They strive to create a healthy collaborative work environment where every employee feels valued and inspired to contribute to their vision “Until every human has their health”.

US

  • Build and maintain the high-throughput, event-driven pipelines responsible for processing the history of assets and vulnerabilities.
  • Design systems that handle massive scale, ensuring data accuracy and real-time availability.
  • Use Terraform and Datadog to deploy, monitor, and ensure the health of services in production.

Tenable is the Exposure Management company, with 44,000 organizations using it to understand and reduce cyber risk. Their global employees support 65 percent of the Fortune 500, 45 percent of the Global 2000, and large government agencies, fostering a culture of belonging, respect, and excellence.

Global

  • Drive end-to-end delivery of core data engineering initiatives.
  • Lead and mentor the Data Engineering team.
  • Own data ingestion and processing for live and historical datasets.

BHFT is a proprietary algorithmic trading firm managing the full trading lifecycle — from software development to designing and deploying trading strategies. We are a 230-person company with a strong technology focus, where 70% of the team are engineers and technical specialists.

Latin America

  • Design and evolve scalable data pipelines and architectures.
  • Act as the primary anchor for data ingestion, transformation, and storage solutions.
  • Ensure mission-critical data is accessible and reliable.

CodeRoad provides end-to-end software development services, helping businesses scale with ideal infrastructure solutions. From staff augmentation to dedicated IT teams and general software engineering, their nearshore technology services empower businesses to thrive in an ever-evolving digital landscape.

$190,000–$280,500/yr
US Canada

  • Identify structural weaknesses and eliminate operational fragility.
  • Define clear ingestion, validation, and testing standards across the platform.
  • Drive ambiguous initiatives from concept to production-ready outcomes.

Life360's mission is to keep people close to the ones they love. By continuing to innovate and deliver for our customers, they have become a household name and the must-have mobile-based membership for families. Life360 has more than 500 (and growing!) remote-first employees.

US

  • Architect and sustain self-healing pipelines using Astronomer/Airflow to ensure 24/7 data availability.
  • Design and optimize event-driven API ingestion frameworks leveraging AWS Lambda and DLT (Data Load Tool).
  • Manage high-performance modeling within AWS Redshift, utilizing DBT to transform raw transactional data into high-fidelity business intelligence.

Odisea helps close the opportunity gap between Colombia and the United States by redefining nearshoring. They are building a passionate team of professionals committed to this purpose.

$92,686–$125,000/yr
US Unlimited PTO

  • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and design data models and schemas that facilitate data analysis and reporting
  • Design, develop, and maintain scalable and efficient data pipelines and ETL processes to ingest, process, and transform large volumes of data from various sources into usable formats
  • Build and optimize data storage and processing systems, including data warehouses, data lakes, and big data platforms, using AWS services such as Amazon Redshift, AWS Glue, AWS EMR, AWS S3, and AWS Lambda, to enable efficient data retrieval and analysis

ATPCO is the world's primary source for air fare content, holding over 200 million fares across 160 countries. Every day, the travel industry relies on ATPCO's technology and data solutions to help millions of travelers reach their destinations efficiently. At ATPCO, they believe in flexibility, trust, and a culture where your wellbeing comes first.

$142,000–$162,500/yr
US

  • Architect, build, and operate data infrastructure that powers Tebra’s intelligent features.
  • Translate business requirements into software solutions that accelerate our ability to deploy AI.
  • Monitor data pipelines, detect anomalies, and implement automated recovery systems.

Tebra unites Kareo and PatientPop, providing a digital backbone for practice well-being, supporting both products with a shared vision for modernized care. Over 100,000 providers trust Tebra to elevate patient experience and grow their practice, building the future of well-being with compassion and humanity.

$135,000–$185,000/yr
Canada

  • Design, deploy, and maintain large-scale Kafka event streaming infrastructure.
  • Collaborate with engineers to enable new features and ensure data pipeline reliability.
  • Execute and automate Kafka cluster upgrades, migrations, and major version rollouts.

Yelp's engineering culture values teamwork, individual authenticity, and creative solutions. They are all about helping their users, growing as engineers, and having fun in a collaborative environment.

Europe 6w PTO

  • Own reliability, scalability and cost discipline of ingestion and transformation systems
  • Design and deliver infrastructure for real-time/near-real-time feature computation
  • Lead and grow a small, ambitious team while raising technical standards

Yazio is a nutrition app with millions of users in over 150 countries, driven by its mission to transform the world through healthy eating. They champion a focus-driven culture that values efficiency, offering a high-impact environment supported by a diverse, international team committed to growth and well-being.

US

  • Define and plan the long-term strategy for the Data Platform.
  • Design and develop scalable distributed systems for data management.
  • Improve and add features to the ETL framework while maintaining SLAs.

Jobgether is a platform that connects job seekers with companies using an AI-powered matching process. It's a platform that ensures applications are reviewed quickly, objectively, and fairly against the role's core requirements.

$120,484–$144,574/yr
Canada 6w PTO

  • Build and maintain production quality data pipelines between operational systems and BigQuery.
  • Implement data quality and freshness checks and monitoring processes to ensure data accuracy and consistency.
  • Maintain and contribute to our ingestion framework that leverages various purpose-built data load tool (dlt) connectors.

Grafana Labs is a remote-first, open-source powerhouse that provides visualization tools. They help companies manage their observability strategies with the Grafana LGTM Stack and have a global collaborative culture with a passion for meaningful work.

Europe Asia

  • Design, implement, and maintain robust, scalable data pipelines to support AI, analytics, and operational reporting
  • Own and evolve the data warehouse architecture, ensuring it meets performance, flexibility, and governance needs
  • Ensure data integrity, availability, lineage, and observability across complex pipelines

Remote People is building the infrastructure to power borderless teams. Their technology handles global payroll, benefits, taxes, and compliance, enabling businesses to compliantly hire anyone anywhere at the push of a button. They are a growing, international family.

$89,440–$94,380/hr
US

  • Design, build, and maintain scalable data pipelines.
  • Develop and optimize ETL/ELT processes using cloud data technologies.
  • Partner with teams to understand data requirements and improve data capture strategies.

Blueprint is a technology solutions firm with a strong presence across the United States, solving complicated problems for their clients. They are bold, smart, agile, and fun, and believe in unique perspectives, building teams of people with diverse skillsets and backgrounds.

$108,400–$135,500/yr
US North America

  • Design, develop, and maintain scalable data pipelines using cloud data services.
  • Serve as a technical leader, defining data engineering standards and best practices.
  • Lead the design and implementation of optimized data models in our cloud data warehouse.

Constant Contact empowers people by giving them the help and tools they need to grow online. They are energized by new challenges and possibilities, and they celebrate diversity and inclusion with programs in place to bring people together.

US

  • Design, build, and maintain streaming services using Kafka, Spring Boot, and Spring Cloud Stream.
  • Develop and manage Kafka connectors for data integration and own schema management and evolution using Protocol Buffers.
  • Collaborate with cross-functional teams on API design, data contracts, and integration patterns, plus write infrastructure as code using Terraform.

Life360's mission is to keep people close to the ones they love through their mobile app and Tile tracking devices. They have more than 500 remote-first employees and deliver peace of mind and enhances everyday family life.

Global

  • Build and maintain robust data pipelines processing large volumes of data
  • Update and optimise our data platform for speed, scalability and cost
  • Develop processes and tools to monitor and analyse model performance and data accuracy

Moniepoint is Africa's all-in-one financial ecosystem, empowering businesses and their customers with seamless payment, banking, credit, and management tools. They processed $182 billion in 2023 and are Nigeria’s largest merchant acquirer, cultivating a culture of innovation, teamwork, and growth.