Source Job

Bulgaria Georgia Poland Romania

  • Define and enforce best practices and coding standards across the project.
  • Design, develop, and maintain robust and scalable Spark applications.
  • Work closely with cross-functional teams to deliver high-quality software solutions.

PySpark Python SQL Spark Databricks

20 jobs similar to Senior Data Engineer (ADB, Spark)

Jobs ranked by similarity.

Europe 7w PTO

  • Drive migration of legacy Hadoop/Spark/Impala data pipelines to a modern Databricks-centric stack.
  • Design and build scalable Airflow DAGs and Databricks Jobs for large-scale data pipelines.
  • Implement robust validation strategies to ensure data parity and quality between legacy and modern systems.

LivePerson is a leader in trusted enterprise conversational AI and digital transformation. Named the #1 Most Innovative AI Company by Fast Company, we power nearly a billion conversational interactions every month for top global brands.

Brazil

  • Own and evolve notebooks across the full medallion architecture, from raw ingestion through a fully modeled dimensional layer.
  • Design and implement dimensional modeling artifacts such as facts, dimensions, and slowly changing dimensions for downstream business intelligence.
  • Serve as the primary technical reference, reviewing pull requests, mentoring team members, and proposing architectural improvements.

CI&T helps large enterprises transform the potential of AI into real business impact with AI Deployment, AI-native execution, and tech-integrated business solutions. With 30 years of experience and 8,000 employees across 25 countries, we foster a collaborative culture that accelerates innovation in Agentic SDLC, Application modernization, Data & AI, Martech, and Business strategy.

California

  • Lead impactful customer technical projects by delivering production-grade systems spanning data engineering, AI, and application development.
  • Guide strategic customers in implementing end-to-end big data and AI projects, including architecture, design, build, and deployment.
  • Empower customers by providing architecture guidance and ensuring solutions are secure, scalable, and aligned with Databricks best practices.

Databricks is the data and AI company. More than 10,000 organizations worldwide, including Comcast and Condé Nast, rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. The company is headquartered in San Francisco and fosters a diverse, inclusive culture.

$25,236–$43,418/yr
India

  • Design and implement end-to-end data solutions using Azure Databricks, PySpark, and Azure Data Factory.
  • Drive automation in data integration and build API-based integrations and real-time ingestion frameworks.
  • Lead technical design reviews, mentor junior engineers, and partner with business stakeholders.

Alimentiv is a life sciences and healthcare technology company that provides data solutions and analytics. The corporate operations team in Bangalore focuses on technology and innovation, employing a team of engineers and data professionals.

US Canada

  • Build and maintain batch data pipelines ingesting from Workday and legacy systems into a medallion lakehouse on Azure Databricks and Microsoft Fabric.
  • Develop transformation logic across Bronze/Silver/Gold layers using Spark, Python, and SQL, and implement data-quality checks.
  • Work within a federated architecture and Unity Catalog security model, contributing to documentation and code reviews.

CampusWorks is a consulting firm that helps higher education institutions leverage technology and managed services to drive transformation and student success. Founded in 1999, it is a large, virtual company with a culture that values work-life balance and employee appreciation.

$0–$215,000/yr
US Unlimited PTO

  • Lead, coach, and develop a global team of data engineers while guiding technical architecture and delivery.
  • Build and scale large-scale data pipelines, production datasets, and QA systems using Databricks, Airflow, SQL, and PySpark.
  • Partner with product and research teams to transform complex data into reliable, production-grade assets for customers and internal applications.

YipitData is a leading market research and analytics firm that analyzes billions of alternative data points to provide actionable insights for the disruptive economy. The company recently raised $475M, operates globally with offices in the US, APAC, and India, and has been recognized by Inc. as a Best Workplace for three consecutive years.

Slovakia

  • Own production data pipelines end-to-end, ensuring reliability, performance, and scalability. - Build and optimize data solutions using PySpark and Foundry tools to process massive datasets. - Champion data quality by designing monitoring and validation frameworks to guarantee trusted data.

We are an IT solutions company providing innovative information and communication technology services. We have grown to over 3,900 employees and are the second largest employer in eastern Slovakia, with a culture focused on continuous improvement and transformation.

Global

  • Design, develop, and maintain data pipelines using Azure Databricks.
  • Build and optimize data transformations using PySpark and SQL in Databricks.
  • Implement and maintain Lakehouse architectures using Delta Lake.

Miratech helps visionaries change the world. We are a global IT services and consulting company with nearly 1000 full-time professionals and a culture of Relentless Performance.

$118,108–$178,650/yr
US

  • You will develop and maintain end-to-end data pipelines and contribute to Samsara's Data Platform for advanced automation and analytics.
  • You will design, build, and optimize large-scale Spark and PySpark workflows for batch and streaming data processing.
  • You will build and maintain MCP servers and AI agents, and champion data engineering best practices across the team.

Samsara is the pioneer of the Connected Operations Cloud, enabling organizations to harness IoT data for actionable insights. As a recently public company, they foster a culture of autonomy, support, and rapid career development in a hyper-growth environment.

Ukraine

  • Design and build batch data pipelines that ingest, validate, and transform multi-billion-row datasets.
  • Model complex real-world data including dimensional models and temporal data.
  • Develop and operate workloads on lakehouse platforms like Databricks, Spark, and Delta.

Simulmedia builds an advanced TV and streaming advertising platform. They have a team of engineers, data scientists, and designers who are obsessed with building cutting-edge technology.

  • Design and implement robust, scalable data ingestion and transformation pipelines using Databricks, PySpark, and distributed processing.
  • Implement Delta Lake principles focusing on CDC and schema evolution, and integrate data quality frameworks within CI/CD pipelines.
  • Develop and optimize complex SQL and Python scripts, handling diverse data sources and supporting data governance solutions.

Mobile Wave Solutions is a professional services company specializing in software development as a service. With a team of over 120 engineers, we deliver scalable, high-quality software that empowers our global clients to innovate and grow.

$70,500–$75,700/yr
Global

  • Enable efficient data access by creating and maintaining data pipelines.
  • Collaborate with ML engineers to design and maintain automation for machine learning training, quality assessment, and model release.
  • Build data infrastructure for analytics, hypothesis testing, and company metrics.

Eneba is building an open, safe, and sustainable marketplace for gamers, supporting close to 20 million active users. We are a growing international team that values data-driven decision making and fosters a healthy data culture.

Brazil

  • Design, develop, and maintain scalable ETL/ELT pipelines and data integration processes.
  • Build and optimize cloud-based data architectures to support analytics and business intelligence initiatives.
  • Ensure data quality, consistency, governance, and reliability through validation, monitoring, and automated quality checks.

CI&T helps large enterprises transform AI potential into business impact with AI deployment, AI-native execution, and tech-integrated solutions. With 30 years of experience and 8,000 employees across 25 countries, they collaborate to build solutions with real impact.

Brazil

  • Analyze, organize, and process large volumes of data to support business and technology decision-making.
  • Develop and maintain data pipelines using Databricks, Python, PySpark, and SQL, ensuring efficiency and quality.
  • Build dashboards, reports, and executive presentations to translate data into actionable insights.

CI&T helps large companies transform AI potential into real business impact with AI deployment, AI-native execution, and tech-integrated business solutions. They have 8,000 employees in over 25 countries, collaborating to build solutions with real impact, with AI integrated into their daily work.

UK

  • Design and maintain scalable batch and near real-time data pipelines in Databricks, integrating data from various sources.
  • Build unified customer profiles and support identity resolution, deduplication, enrichment, and Golden Record creation.
  • Enable CRM and marketing teams to access trusted, activation-ready customer data with minimal latency.

Massive Rocket is a rapidly scaling Braze and Snowflake agency that transforms how digital marketing, product, and engineering teams connect. They have grown quickly in five years and are aiming for $100M in revenue, with a culture of ownership, collaboration, and growth.

Global

  • Develop scalable backend systems and data pipelines using Python, PySpark, and SQL.
  • Build secure, containerized applications with Docker and cloud platforms.
  • Collaborate with cross-functional teams to deliver high-quality engineering solutions.

Resilinc is a supply chain intelligence company that uses agentic AI to help enterprises predict and mitigate disruptions. They are a fully remote, mission-led team with a collaborative culture.

Global 7w PTO

  • Lead the modernization of the data platform by migrating legacy Hadoop, Spark, and Impala pipelines to a scalable Databricks architecture.
  • Accelerate migration efforts using AI coding assistants like Claude and Codex to convert SQL and modernize ETL workflows.
  • Design and optimize scalable data pipelines with Airflow and Databricks, ensuring reliability, cost-efficiency, and data quality.

LivePerson is a leader in enterprise conversational AI and digital transformation, powering nearly a billion conversational interactions monthly. Fast Company named them the #1 Most Innovative AI Company, and they foster a remote-first, innovative culture.

$115,000–$175,000/yr
US Unlimited PTO

  • Own the Airflow codebase end-to-end, building reusable templates and enforcing standards.
  • Build and extend large-scale Spark pipelines on AWS Glue and support migration to Databricks.
  • Drive data model improvements around commercial pharma data with focus on structure and lineage.

Veeva Systems is a mission-driven organization and pioneer in industry cloud, helping life sciences companies bring therapies to patients faster. As one of the fastest-growing SaaS companies in history, it surpassed $3B in revenue and values doing the right thing, customer success, employee success, and speed.

$140,000–$210,000/yr
US

  • Design and build ingestion pipelines from enterprise source systems into the Databricks lakehouse using Delta Lake, owning Bronze-layer ingestion and building Silver-layer pipelines for cleansing and standardization.
  • Implement and maintain Databricks platform constructs for secure delivery, including catalogs, schemas, service principals, and job orchestration, and build CI/CD pipelines for data platform assets.
  • Apply data classification and segregation requirements within pipeline design, build data quality controls reflecting business meaning, and partner with teams to ensure reliable, governed data for downstream use.

Shield AI is a venture-backed defense-tech company founded in 2015 with the mission of protecting service members and civilians with intelligent systems, developing products like Hivemind autonomy software and V-BAT and X-BAT aircraft. The company has offices and facilities across the U.S., Europe, the Middle East, and Asia-Pacific, and its technology actively supports operations worldwide.

$130,000–$165,000/yr
US

  • Design, build, and maintain scalable data pipelines and systems using Python, PySpark, and AWS-native services.
  • Develop and optimize data platforms on AWS, leveraging technologies like Redshift, Glue, and Athena.
  • Mentor junior engineers and collaborate with cross-functional teams in an Agile environment.

Capital Technology Group provides expert consulting services in software development, digital transformation, and data analytics. Recognized as a Top Workplace by The Washington Post, they foster a culture where employees feel trusted and empowered.