Source Job

Germany

  • Architect and improve real-time data streaming systems processing millions of events per second with ultra-low latency.
  • Lead development of core data infrastructure enabling real-time decision-making and personalization.
  • Solve complex distributed systems challenges including fault tolerance, scalability, and performance optimization.

Kafka Distributed Systems

20 jobs similar to Principal Engineer — Real-Time Data Systems

Jobs ranked by similarity.

India

  • Design and implement scalable, low-latency real-time data streaming architectures and end-to-end data pipelines for high-volume systems.
  • Develop clean, maintainable, and efficient code using technologies such as Go, Python, TypeScript/Node.js, Scala, and SQL.
  • Build and optimize complex data processing workflows handling structured and unstructured data sources.

Our partner is looking for a Sr. Data Engineer - Data Analytics based in India. The company operates in a global, remote-first environment with a multicultural team spanning 45+ nationalities, focusing on work-life balance and employee well-being.

Global 4w PTO

  • Design, build, and maintain streaming data solutions based on Apache Kafka and related technologies.
  • Build and maintain data pipelines using Apache Kafka, including topics, partitions, and consumer group tuning.
  • Write and maintain unit and integration tests for streaming topologies.

GR8 Tech builds B2B iGaming platforms for operators who play to lead. With 1000+ employees across multiple time zones, they foster a culture of trust, ownership, and growth.

Brazil

  • Design, develop, and optimize large-scale distributed systems for real-time data synchronization and streaming.
  • Drive architectural decisions for multi-region deployments and cloud-native infrastructure.
  • Collaborate with engineering teams to deliver scalable solutions with direct customer impact.

The partner company builds distributed infrastructure for global data-intensive platforms. They foster a remote-first culture with an emphasis on autonomy, ownership, and technical excellence.

Europe

  • Design and deliver near real-time data solutions for the analytics platform.
  • Analyze business needs, optimize data models, and identify slow queries for performance improvement.
  • Write clean, scalable code using Scala, Python, and SQL while mentoring team members.

Aircall is an AI-powered customer communications platform used by 22,000+ companies worldwide. It is a unicorn startup with offices across multiple countries and a focus on innovation and collaboration.

US Unlimited PTO

  • Design and implement scalable lakehouse architectures using Bronze, Silver, and Gold patterns with technologies like Kafka, Spark, and Airflow.
  • Build and manage high-performance streaming and batch data pipelines and open table format solutions such as Iceberg, Delta Lake, and Hudi.
  • Optimize distributed query environments, maintain platform reliability, and partner with data scientists and product teams to deliver impactful data capabilities.

The partner company is building scalable data platforms that power analytics, machine learning, and next-generation products. They offer a collaborative and supportive work environment focused on innovation and continuous learning.

$100,000–$150,000/yr
US

  • Design and build scalable backend platforms and shared infrastructure.
  • Architect high-throughput, low-latency systems with event-driven architectures.
  • Establish observability standards, mentor engineers, and drive technical excellence.

The company is a technology organization focused on building scalable backend platforms. They operate in a collaborative environment with experienced engineers and cross-functional teams.

$170,000–$240,000/yr
US

  • Build and scale mission-critical order and execution management infrastructure in Rust.
  • Design systems balancing low-latency execution, fault tolerance, and correctness across distributed trading workflows.
  • Translate evolving regulatory and market structure requirements into reliable, testable platform capabilities.

Clear Street is a diversified financial services firm modernizing the brokerage ecosystem with a cloud-native clearing and custody system. Founded in 2018, the company is a small, growing team with a meritocratic culture that champions collaboration.

$150,000–$190,000/yr
US

  • Design and build a real-time notification platform for low-latency alerts and account updates.
  • Build and operate Kafka/MSK streaming pipelines for live trading data ingestion.
  • Develop stateful stream processing applications for risk detection and fraud monitoring.

Take Profit Trader is a high-growth proprietary trading firm handling hundreds of millions of dollars in trading volume. They are dedicated to innovation, operational excellence, and empowering traders globally.

$119,900–$193,200/yr
Global Unlimited PTO

  • Build and evolve features in the event-sourced engine and its C8 REST/gRPC/MCP API.
  • Own well-scoped work end-to-end — implement, test, and ship.
  • Help ship high-impact engine features like suspending and resuming process instances, enabling AI agents to steer running processes.

Camunda is the enterprise platform for agentic orchestration, coordinating AI agents, people, and systems. Trusted by over 700 organizations, including 9 of top 10 US banks, Camunda is a fast-growing, fully remote company with a Great Place to Work certification.

$160,000–$200,000/yr
Global Unlimited PTO

  • Contribute to the architecture and improvement of our data acquisition and processing platform, increasing reliability, throughput, and observability.
  • Use and develop web crawling technologies to capture and catalog data on the internet.
  • Build, operate, and evolve large-scale distributed systems that collect, process, and deliver data from across the web.

People Data Labs provides people and company data, integrating thousands of compliantly sourced datasets into a single source of truth. They are a remote-first company focused on building innovative data solutions, with a collaborative team that values ownership and learning from failure.

Global

  • Design and implement a scalable event-driven communications platform for high-load multi-channel delivery.
  • Build highly reliable and fault-tolerant message delivery systems ensuring delivery continuity.
  • Manage large-scale real-time event processing pipelines and implement provider failover strategies.

Sigma Software is building a high-load multi-channel communications platform for an EdTech company, delivering critical notifications to millions of users. They offer a remote, international engineering environment with opportunities to influence architectural decisions and collaborate with experienced teams on modern cloud-native solutions.

North America Latin America

  • Design, build, and evolve the core data platform infrastructure including distributed query engines, orchestration, and warehousing.
  • Own the lakehouse infrastructure as code, managing deployments through Terraform and Ansible on Kubernetes.
  • Build and maintain low-latency streaming and CDC ingestion pipelines, as well as batch ingestion paths landing in Iceberg.

Alpaca is a US-headquartered global leader in agent-first brokerage infrastructure for stocks, ETFs, options, crypto, and more. The company has a global team of 400+ members, is backed by $400M in funding, and fosters a culture of curiosity, empathy, and accountability.

US 3w PTO 20w maternity 20w paternity

  • Design and build core financial systems including trading, ledger, and billing.
  • Develop systems for transaction processing, reconciliation, and portfolio state management.
  • Build and scale real-time and batch data pipelines.

Arta leverages AI and digital tools to make financial products accessible to a broader global audience. The company values trust, teamwork, and adaptability.

$50,350–$50,350/yr
India

  • Design, build, and optimize scalable data platforms supporting analytics, AI/ML, and enterprise reporting.
  • Develop and maintain complex data pipelines using AWS Glue, Step Functions, and Databricks Workflows.
  • Collaborate with product, engineering, analytics, and ML teams to transform complex data challenges into reliable solutions.

Jobgether uses AI to match candidates with job openings for faster, fairer reviews. It is a technology platform focused on streamlining the hiring process for both candidates and employers.

Europe

  • Design, build, and maintain scalable batch and streaming data pipelines.
  • Develop reliable ETL/ELT workflows using Python, Spark, and modern orchestration tools.
  • Improve data quality, validation, monitoring, and observability across the platform.

The company is a Berlin-based, remote-first technology company building advanced market intelligence and software solutions for the automotive industry. It operates in a stable growth phase with an established product and a strong technical team.

Ireland

  • Design and implement real-time services with high throughput and low latency, then verify, deploy and operationalize them.
  • Collaborate with stakeholders to understand customer needs and deliver simple, robust, and scalable solutions.
  • Embrace the challenge of scaling a complex distributed platform with global points of presence, ensuring high availability and reliability.

Twilio delivers innovative communication solutions to hundreds of thousands of businesses and empowers millions of developers worldwide. They are a remote-first company with a strong culture of connection and global inclusion, employing a diverse global team.

Europe US

  • Build and maintain core market data infrastructure in Rust, focusing on ingestion, processing, storage, and serving of high-volume real-time data.
  • Solve practical problems specific to real-time market data, including cross-exchange pricing differences, data quality, and latency.
  • Bring real market data or trading systems knowledge into engineering decisions and communicate clearly with the team.

Douro Labs builds Pyth Pro, real-time market data infrastructure distributing institutional-grade price feeds to exchanges and trading firms. The company has a distributed team across the US, South America, Europe, and Asia, with a strong concentration in Europe, and a culture of independent work and growth.

Europe

  • Design and build scalable batch data pipelines using AWS Glue, Lambda, and Step Functions.
  • Optimize analytical data models and query layers with Amazon Athena, Redshift, and ClickHouse.
  • Collaborate with backend engineers to integrate data workflows with microservices and event-driven architectures.

The company is a technology organization focused on building scalable data platforms and analytics solutions. They operate with a distributed international team and emphasize modern engineering practices.

Brazil

  • Lead technical direction of the data team, designing scalable data architectures for batch and streaming processing.
  • Translate business requirements into efficient data solutions and collaborate with CRM and Martech teams.
  • Mentor engineers and define data governance, quality, security, and observability standards.

Jobgether is an AI-powered job matching platform that connects candidates with hiring companies. The company uses automated processes to review applications and share top-fitting candidates directly with employers.

$170,000–$220,000/yr
US Unlimited PTO 12w maternity 12w paternity

  • Design and deliver large-scale, real-time systems with high quality, scalability, and operability.
  • Collaborate with product management, data engineering, and teams to bring end-to-end solutions to customers.
  • Take operational ownership using monitoring and observability tools to identify and respond to issues.

Signifyd helps merchants grow their businesses by building trusted relationships and providing fraud-free commerce solutions. We securely process billions of transactions annually and foster a culture of commitment, empathy, and creativity.