Source Job

Europe

  • Design and deliver near real-time data solutions for the analytics platform.
  • Analyze business needs, optimize data models, and identify slow queries for performance improvement.
  • Write clean, scalable code using Scala, Python, and SQL while mentoring team members.

Scala Python Kafka Data Modeling

20 jobs similar to Senior Data Engineer, Real-Time Analytics

Jobs ranked by similarity.

Europe

  • Design, build, and maintain backend services, REST APIs, databases, and big data pipelines that power customer-facing insights and analytics.
  • Implement and maintain near-real-time stream-based data processing pipelines in collaboration with batch-oriented data refresh workflows.
  • Scale data processing and insights generation pipelines to handle growing volumes of activity data while managing infrastructure costs.

Backstory helps companies understand the state of their revenue business by answering questions that span customer interactions, sales activity, pipeline health, and deal execution. Headquartered in San Francisco, CA, Backstory is backed by Y Combinator and top investors, and is listed in the top 20 percent of Inc 5000 companies.

India

  • Design and implement scalable, low-latency real-time data streaming architectures and end-to-end data pipelines for high-volume systems.
  • Develop clean, maintainable, and efficient code using technologies such as Go, Python, TypeScript/Node.js, Scala, and SQL.
  • Build and optimize complex data processing workflows handling structured and unstructured data sources.

Our partner is looking for a Sr. Data Engineer - Data Analytics based in India. The company operates in a global, remote-first environment with a multicultural team spanning 45+ nationalities, focusing on work-life balance and employee well-being.

Global Unlimited PTO

  • Architect and maintain cloud-native data platforms (AWS, Snowflake, Databricks) supporting batch and streaming use cases.
  • Design and automate ETL/ELT workflows, optimize data models, and enable self-serve analytics and AI.
  • Manage end-to-end data lifecycles including ingestion, storage, processing, and delivery of structured and unstructured data.

Trustonic makes smartphones affordable for the many, enabling global access to devices and digital finance through secure smartphone locking technology. They partner with mobile carriers, retailers, and financiers across 30+ countries, and pride themselves on a diverse, inclusive culture that values doing the right thing for each other, the community, and the planet.

UK

  • Build and maintain data pipelines for analytics, ML, and product applications.
  • Design scalable data infrastructure with a focus on quality and observability.
  • Collaborate with cross-functional teams to understand data needs and implement solutions.

Prolific builds human data infrastructure to power the next wave of AI innovation. They are a remote-first company focused on ethical data collection and mission-driven culture.

Global

  • Architect and implement scalable ETL and data pipelines for real-time risk management and advanced analytics.
  • Design, develop, and optimize distributed data storage solutions for high performance and reliability at scale.
  • Drive schema evolution, data modeling, and pipeline orchestration with ownership of end-to-end data flow.

Oscilar builds the most advanced AI Risk Decisioning™ Platform for banks, fintechs, and digitally native organizations to manage fraud, credit, and compliance risk. The company is mission-driven with a remote-first culture and team members from Meta, Uber, Citi, and Confluent.

$50,350–$50,350/yr
India

  • Design, build, and optimize scalable data platforms supporting analytics, AI/ML, and enterprise reporting.
  • Develop and maintain complex data pipelines using AWS Glue, Step Functions, and Databricks Workflows.
  • Collaborate with product, engineering, analytics, and ML teams to transform complex data challenges into reliable solutions.

Jobgether uses AI to match candidates with job openings for faster, fairer reviews. It is a technology platform focused on streamlining the hiring process for both candidates and employers.

Europe

  • Design, build, and maintain scalable batch and streaming data pipelines.
  • Develop reliable ETL/ELT workflows using Python, Spark, and modern orchestration tools.
  • Improve data quality, validation, monitoring, and observability across the platform.

The company is a Berlin-based, remote-first technology company building advanced market intelligence and software solutions for the automotive industry. It operates in a stable growth phase with an established product and a strong technical team.

Brazil

  • Lead technical direction of the data team, designing scalable data architectures for batch and streaming processing.
  • Translate business requirements into efficient data solutions and collaborate with CRM and Martech teams.
  • Mentor engineers and define data governance, quality, security, and observability standards.

Jobgether is an AI-powered job matching platform that connects candidates with hiring companies. The company uses automated processes to review applications and share top-fitting candidates directly with employers.

Europe 7w PTO

  • Drive migration of legacy Hadoop/Spark/Impala data pipelines to a modern Databricks-centric stack.
  • Design and build scalable Airflow DAGs and Databricks Jobs for large-scale data pipelines.
  • Implement robust validation strategies to ensure data parity and quality between legacy and modern systems.

LivePerson is a leader in trusted enterprise conversational AI and digital transformation. Named the #1 Most Innovative AI Company by Fast Company, we power nearly a billion conversational interactions every month for top global brands.

UK

  • Design, develop, and maintain scalable data pipelines that transform complex customer data into actionable business value.
  • Work across the full data lifecycle, from ingestion and transformation to activation and analytics.
  • Use modern cloud technologies and AI-assisted development workflows to create reliable, high-performing data solutions.

Jobgether uses an AI-powered matching process to help candidates find roles and connects top-fitting applicants directly with hiring companies. The company fosters a remote, collaborative environment with a focus on efficient recruitment.

Europe

  • Build and scale data infrastructure powering targeting, identity, and measurement capabilities.
  • Optimize core ETL/ELT pipelines and ensure operational reliability with documented SLAs.
  • Implement privacy-compliant data methodologies meeting GDPR/CCPA standards.

Kargo creates powerful moments of connection between brands and consumers to build businesses. With 600+ employees and offices across the US, UK, Australia, and Ireland, they take a creative science approach to deliver unique ad experiences across premium platforms.

$86,870–$112,420/yr
Canada

  • Architect Spark-driven workflows at scale and design data platforms as products for internal teams.
  • Develop and maintain end-to-end data pipelines and backend ingestion workflows across multiple sources.
  • Champion Samsara's cultural principles and mentor junior team members to drive data-driven decisions.

Samsara is the pioneer of the Connected Operations Cloud, enabling organizations to harness IoT data for actionable insights to improve safety, efficiency, and sustainability. As a recently public company, it fosters a culture of rapid career development, ownership, and high performance.

$100,000–$150,000/yr
US 4w PTO

  • Design, build, and maintain robust data pipelines and data lake architecture for both batch and real-time streaming use cases.
  • Optimize ETL/ELT workflows for performance, scalability, and fault tolerance, and develop dbt workflows for partner analysis.
  • Collaborate with analytics, product, and ML engineers to develop and deploy reliable data products and support machine learning initiatives.

NinjaTrader is an industry-leading trading platform and futures broker that empowers traders with cutting-edge products and services. Since 2003, the company has grown to over 2 million users and is the number one rated futures brokerage worldwide, fostering a dynamic culture focused on social connection, professional development, and employee recognition.

$160,000–$180,000/yr
US Unlimited PTO

  • Build and operate production-grade ingestion pipelines from clinical, operational, and third-party systems into a Databricks lakehouse.
  • Develop and maintain dbt models to transform raw data into clean, documented, analytics-ready datasets.
  • Establish data quality, testing, and monitoring practices to ensure pipeline reliability and performance.

Zócalo Health is a tech-enabled, community-oriented primary care organization serving underserved populations with culturally competent care. Founded in 2021, the company is backed by leading healthcare investors and is scaling rapidly with a focus on value-based care.

Global 7w PTO

  • Lead the modernization of the data platform by migrating legacy Hadoop, Spark, and Impala pipelines to a scalable Databricks architecture.
  • Accelerate migration efforts using AI coding assistants like Claude and Codex to convert SQL and modernize ETL workflows.
  • Design and optimize scalable data pipelines with Airflow and Databricks, ensuring reliability, cost-efficiency, and data quality.

LivePerson is a leader in enterprise conversational AI and digital transformation, powering nearly a billion conversational interactions monthly. Fast Company named them the #1 Most Innovative AI Company, and they foster a remote-first, innovative culture.

  • Design and implement robust, scalable data ingestion and transformation pipelines using Databricks, PySpark, and distributed processing.
  • Implement Delta Lake principles focusing on CDC and schema evolution, and integrate data quality frameworks within CI/CD pipelines.
  • Develop and optimize complex SQL and Python scripts, handling diverse data sources and supporting data governance solutions.

Mobile Wave Solutions is a professional services company specializing in software development as a service. With a team of over 120 engineers, we deliver scalable, high-quality software that empowers our global clients to innovate and grow.

India

  • Design, build, and scale cloud-based data platforms that support critical business insights and operations.
  • Collaborate with cross-functional teams to extract, load, and transform data using cloud-native principles.
  • Mentor engineers and drive architectural direction through code reviews, testing, and documentation.

Credit Acceptance is a leading used car finance company in the United States. It has a world-class culture shaped by dedicated Team Members and a shared drive to succeed.

France

  • Design, develop, and maintain robust, scalable, and well-documented data pipelines.
  • Collaborate with the Tech Lead to ensure quality, performance, and maintainability of Data products.
  • Optimize data processing and operational costs while working closely with Data Analysts and Scientists.

Accor Tech & Digital is the innovation and technological transformation lab of the world leader in hospitality. Our 5,000 talents are committed to delivering tech and digital experiences across 110 countries, shaping the future of hospitality with a strong culture focused on development and sustainability.

$185,000–$220,000/yr
US Unlimited PTO

  • Design, build, and maintain robust, scalable batch and streaming data processing, storage, and integration pipelines.
  • Take full ownership of building features from the ground up, mentoring and leading your team to deliver the right solutions.
  • Partner with data scientists and engineers to create semantic data models and integrate applications across Shift5 componentry.

Shift5 is building the data platform for onboard operational technology (OT), delivering cybersecurity, predictive maintenance, and compliance capabilities for defense and commercial fleets. They are a growing company with a team-based environment, committed to building an inclusive culture and embracing diversity.

India

  • Design, develop, and maintain scalable data pipelines and ETL/ELT workflows on AWS.
  • Modernize legacy data platforms and optimize data pipelines for performance, scalability, and cost efficiency.
  • Implement data governance, data quality frameworks, and collaborate with stakeholders to enable analytics and reporting.

Tech Holding is a full-service consulting firm that delivers predictable outcomes and high-quality solutions to clients. Our founders and team members have deep industry experience from startups to Fortune 50 companies, guided by principles of expertise, integrity, transparency, and dependability.