Source Job

  • Architect and implement scalable Lakehouse solutions using Delta Tables and Delta Live Tables.
  • Design and orchestrate complex data workflows using Databricks Workflows and Jobs.
  • Develop production-grade Python and PySpark code, including custom Python libraries.

Python PySpark SQL Databricks Azure

20 jobs similar to Senior Data Engineer (Databricks Specialist)

Jobs ranked by similarity.

US

  • Design and engineer robust data pipelines using technologies like Databricks, Azure Data Factory, Apache Spark, and Delta Lake.
  • Craft healthcare data solutions - processing massive healthcare datasets, optimizing performance, and ensuring data is accurate and secure.
  • Communicate technical concepts to non-technical stakeholders, manage multiple priorities, and meet deadlines.

Gentiva offers compassionate care in the comfort of patients' homes as a national leader in hospice, palliative, home health care, and advanced illness management. They have nearly 600 locations and thousands of clinicians across 38 states, offering rewarding careers in a collaborative environment.

  • Design and implement data ingestion and transformation pipelines using Databricks, PySpark, and distributed processing.
  • Implement Delta Lake principles, focusing on CDC and schema evolution, integrating data quality frameworks within CI/CD pipelines for data integrity.
  • Develop and optimize complex SQL and Python scripts, handle both structured and unstructured data, and improve inconsistent legacy datasets.

Mobile Wave Solutions is a professional services company specializing in software development as a service, with a team of over 120 engineers.

US Unlimited PTO

  • Partner with clients and implementation teams to understand data distribution requirements.
  • Design and develop data pipelines integrating with Databricks and Snowflake, ensuring accuracy and integrity.
  • Lead architecture and implementation of solutions for health plan clients, optimizing cloud-based technologies.

Abacus Insights is changing the way healthcare works by unlocking the power of data to enable the right care at the right time. Backed by $100M from top VCs, they're tackling big challenges in an industry that’s ready for change with a bold, curious, and collaborative team.

$215,000–$240,000/yr
US

Own the design, build, and optimization of end-to-end data pipelines. Establish and enforce best practices in data modeling, orchestration, and system reliability. Collaborate with stakeholders to translate requirements into robust, scalable data solutions.

YipitData is the leading market research and analytics firm for the disruptive economy and most recently raised $475M from The Carlyle Group at a valuation of over $1B.

India

Provide leadership and guidance to the data engineering team, fostering a collaborative work environment. Provide technical expertise and direction in data engineering, guiding the team in selecting appropriate tools and methodologies. Oversee the design and architecture of data solutions, collaborating with data architects and other stakeholders.

Lingaro has been on the market since 2008, with 1300+ talents currently on board in 7 global sites.

India

Collaborate with stakeholders to understand business requirements and translate them into data engineering solutions. Design and oversee the data architecture and infrastructure, ensuring scalability, performance, and security. Create scalable and efficient data processing frameworks, including ETL processes and data pipelines.

Lingaro has been on the market since 2008, with 1500+ talents currently on board in 7 global sites and emphasizes career growth and skills development.

$110,000–$140,000/yr
US

  • Design, build, and maintain scalable and reliable data pipelines.
  • Develop and maintain ETL data pipelines for large volumes of data, writing clean, maintainable, and efficient code.
  • Work closely with product managers, data scientists, and software engineers to create and prepare datasets from disparate sources.

Curinos empowers financial institutions to make better, faster and more profitable decisions through industry-leading proprietary data, technologies and insights.

Europe Unlimited PTO

  • Design and implement data cataloging infrastructure to make datasets discoverable and connected.
  • Develop consistent data access patterns and libraries for engineers and data scientists.
  • Collaborate with Data Engineers to ensure platform infrastructure complements data pipelines.

Jobgether helps people find jobs using an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly.

US 4w PTO

  • Lead and deliver high-impact data engineering and analytics projects.
  • Oversee enterprise-scale data platforms and cloud-native solutions.
  • Collaborate with cross-functional teams to drive data modernization and AI enablement.

This position is posted by Jobgether on behalf of a partner company.

Brazil Colombia Mexico Argentina 2w PTO

  • Build and optimize Sauce's lakehouse architecture using Azure Databricks and Unity Catalog for data governance.
  • Create and maintain data quality tests and improve existing alerting setups.
  • Own data warehouse by connecting data sources, and maintaining a platform and architecture in coordination with R&D infrastructure and operations teams.

Sauce is a premier restaurant technology platform that helps businesses grow with our Commission-Free Delivery & Pickup structure and proprietary delivery optimization technology.

Latam

Work with data end-to-end, exploring, cleaning, and assembling large, complex datasets. Analyze raw data from multiple sources and identify trends and patterns, maintaining reliable data pipelines. Build analytics-ready outputs and models that enable self-service and trustworthy insights across the organization.

Truelogic is a leading provider of nearshore staff augmentation services headquartered in New York, delivering top-tier technology solutions for over two decades.

$155,000–$180,000/yr
US

  • Design, build, and maintain robust and scalable data pipelines from diverse sources.
  • Leverage expert-level experience with dbt and Snowflake to structure, transform, and organize data.
  • Collaborate with engineering, product, and analytics teams to deliver data solutions that drive business value.

Topstep is an engaging working environment which ranges from fully remote to hybrid and they foster a culture of collaboration.

US Europe

  • Design and develop scalable data pipelines and infrastructure to process large volumes of data efficiently
  • Collaborate with cross-functional teams to ensure data integrity, accessibility, and usability
  • Implement and maintain data quality measures throughout the data lifecycle

CI&T is a tech transformation specialist, uniting human expertise with AI to create scalable tech solutions. With over 8,000 employees around the world, they have a culture that values diverse identities and life experiences, fostering a diverse, inclusive, and safe work environment.

$1,800,000–$200,000/yr
US Canada

  • Collaborate with engineering, data science, ML, data engineering, and product analytics teams to understand and shape the future needs of our data platform and infrastructure.
  • Define, drive, and implement the future live ingestion layer of data into our data platform (e.g. Kafka, Kinesis).
  • Define and evolve standards for storage, compute, data management, provenance, and orchestration.

Inspiren offers the most complete and connected ecosystem in senior living.

Europe Unlimited PTO

Design, implement, and maintain scalable ETL/ELT pipelines using Python, SQL, and modern orchestration frameworks. Build and optimize data models and schemas for cloud warehouses and relational databases, supporting AI and analytics workflows. Lead large-scale data initiatives from planning through execution, ensuring performance, cost efficiency, and reliability.

This position is posted by Jobgether on behalf of a partner company.

South America

  • Design, develop, and maintain scalable and robust data pipelines.
  • Create solutions for data ingestion, transformation, and modeling using Databricks, Spark/PySpark, Cloudera, and Azure Data Factory (ADF).
  • Ensure the quality, integrity, and usability of data throughout the entire pipeline.

CI&T specializes in technological transformation, uniting human expertise with AI to create scalable tech solutions. With over 8,000 CI&Ters worldwide, they have partnered with over 1,000 clients during their 30-year history, with a focus on Artificial Intelligence.

Americas EMEA

  • Build and scale data services by designing, developing, and maintaining scalable backend systems and APIs.
  • Collaborate on data architecture and models, partnering with engineering and analytics teams to optimize storage and processing workflows.
  • Contribute to standards, quality, and governance by building reliable, observable data systems with strong testing and validation.

Zapier builds and uses automation every day to make work more efficient, creative, and human.

$150,000–$165,000/yr
US Unlimited PTO 11w maternity

  • Partner with our customer teams to develop engineering plans to implement our health system partners
  • Build and support robust batch and streaming pipelines
  • Evolve the maturity of our monitoring systems and processes to improve visibility and failure detection in our infrastructure

Paradigm is rebuilding the clinical research ecosystem by enabling equitable access to trials for all patients. Incubated by ARCH Venture Partners and backed by leading healthcare and life sciences investors, Paradigm’s seamless infrastructure implemented at healthcare provider organizations, will bring potentially life-saving therapies to patients faster.

$155,000–$185,000/yr
US Unlimited PTO

As a Senior Data Engineer, shape a scalable data platform that drives business insights. Design and maintain robust data pipelines and collaborate with cross-functional teams. Tackle complex data challenges, implement best practices, and mentor junior engineers.

Jobgether is a Talent Matching Platform that partners with companies worldwide to efficiently connect top talent with the right opportunities through AI-driven job matching.

$105,000–$165,000/yr
US Unlimited PTO

  • Lead end-to-end data science and ML engagements on Microsoft Azure, Microsoft Fabric, and Databricks to solve manufacturing, supply chain, and operations use cases for clients.
  • Design and implement advanced analytics solutions using Azure Machine Learning, Azure OpenAI, Databricks (PySpark/MLflow), and Power BI, ensuring they are secure, scalable, and aligned to delivery standards.
  • Build modern retrieval and RAG patterns on Azure to expose knowledge from SOPs, service histories, maintenance logs, and data sources commonly associated with manufacturing, supply chain, and logistics.

MCA Connect helps manufacturers succeed by unlocking innovation with actionable business insights through strategic solutions, innovation, and industry intelligence. Established in 2002, MCA Connect has grown into one of the largest US-based solution partners in Microsoft Business Applications and Azure Data & AI / Digital & App Innovation and is a three-time Inc. Best Workplaces award winner.