Source Job

Global

  • Design, develop, and maintain data pipelines using Azure Databricks.
  • Build and optimize data transformations using PySpark and SQL in Databricks.
  • Implement and maintain Lakehouse architectures using Delta Lake.

Azure Databricks PySpark SQL Azure Data Factory Delta Lake

20 jobs similar to Middle Data Engineer (Azure Databricks)

Jobs ranked by similarity.

US Canada

  • Build and maintain batch data pipelines ingesting from Workday and legacy systems into a medallion lakehouse on Azure Databricks and Microsoft Fabric.
  • Develop transformation logic across Bronze/Silver/Gold layers using Spark, Python, and SQL, and implement data-quality checks.
  • Work within a federated architecture and Unity Catalog security model, contributing to documentation and code reviews.

CampusWorks is a consulting firm that helps higher education institutions leverage technology and managed services to drive transformation and student success. Founded in 1999, it is a large, virtual company with a culture that values work-life balance and employee appreciation.

$25,236–$43,418/yr
India

  • Design and implement end-to-end data solutions using Azure Databricks, PySpark, and Azure Data Factory.
  • Drive automation in data integration and build API-based integrations and real-time ingestion frameworks.
  • Lead technical design reviews, mentor junior engineers, and partner with business stakeholders.

Alimentiv is a life sciences and healthcare technology company that provides data solutions and analytics. The corporate operations team in Bangalore focuses on technology and innovation, employing a team of engineers and data professionals.

Peru

  • Design and build production data pipelines using Databricks technologies such as Lakeflow, Autoloader, and Structured Streaming.
  • Architect and implement Lakehouse solutions on Databricks with medallion architecture, Delta Lake, and Unity Catalog.
  • Consult with clients to understand data challenges and implement sustainable data strategies and solutions.

Livefront helps companies design and build world-class digital products that command attention and inspire joy. They are a consultancy with a reputation for excellence, working with household names and startups, and they value collaboration, quality, and community.

US

  • Lead the technical migration from legacy SQL Server to Databricks Lakehouse, ensuring best practice Lakehouse design.
  • Design robust ETL/ELT frameworks using PySpark, Delta Live Tables, and Databricks Workflows.
  • Enforce governance standards and implement data security using Unity Catalog.

We are an IT staffing and consulting firm that provides specialized engineers to government clients. Our culture emphasizes quality placements and technical excellence.

Brazil

  • Analyze, organize, and process large volumes of data to support business and technology decision-making.
  • Develop and maintain data pipelines using Databricks, Python, PySpark, and SQL, ensuring efficiency and quality.
  • Build dashboards, reports, and executive presentations to translate data into actionable insights.

CI&T helps large companies transform AI potential into real business impact with AI deployment, AI-native execution, and tech-integrated business solutions. They have 8,000 employees in over 25 countries, collaborating to build solutions with real impact, with AI integrated into their daily work.

India

  • Design and maintain scalable data pipelines using Microsoft Fabric, Databricks, and Azure services.
  • Optimize ETL/ELT processes for performance and cost efficiency.
  • Collaborate with cross-functional teams to transform data requirements into robust solutions.

The company builds modern cloud-based data platforms to power enterprise analytics and decision-making. It offers a fully remote, collaborative environment with global stakeholder interaction and opportunities for professional growth.

EU

  • Design and build scalable data pipelines for high-impact data products across multiple business domains.
  • Drive cloud data migration initiatives and modernize existing platforms using Azure-based solutions.
  • Collaborate with Data Analysts, ML Engineers, and business stakeholders to deliver robust end-to-end data solutions.

Redcare Pharmacy is Europe's No.1 e-pharmacy, driven by innovation and passionate teams to achieve the vision of global health. They foster a collaborative culture where every employee feels valued and inspired.

$140,000–$170,000/yr
US

  • Design, build, and maintain scalable data pipelines and analytics infrastructure on Azure Databricks.
  • Develop and optimize ETL/ELT processes to ingest and transform data from multiple sources.
  • Collaborate with cross-functional teams to deliver trusted, analytics-ready datasets for business intelligence.

Indigenous Pact is a technology company specializing in data platform and analytics solutions, with a focus on healthcare and indigenous communities. They foster a culture of empathy, wisdom, bravery, and transformation, and offer a remote-first work environment.

  • Design and implement robust, scalable data ingestion and transformation pipelines using Databricks, PySpark, and distributed processing.
  • Implement Delta Lake principles focusing on CDC and schema evolution, and integrate data quality frameworks within CI/CD pipelines.
  • Develop and optimize complex SQL and Python scripts, handling diverse data sources and supporting data governance solutions.

Mobile Wave Solutions is a professional services company specializing in software development as a service. With a team of over 120 engineers, we deliver scalable, high-quality software that empowers our global clients to innovate and grow.

$97,000–$130,000/yr
North America

  • Analyze, develop, and deliver business intelligence solutions using the Microsoft Analytics stack.
  • Work directly with clients to understand business problems and translate them into scalable data solutions.
  • Build and maintain databases, data pipelines, and data lakes while ensuring data quality and reliability.

NRI is a consulting firm specializing in data analytics and business intelligence solutions. They offer a collaborative, team-oriented environment with opportunities for growth and development.

$140,000–$210,000/yr
US

  • Design and build ingestion pipelines from enterprise source systems into the Databricks lakehouse using Delta Lake, owning Bronze-layer ingestion and building Silver-layer pipelines for cleansing and standardization.
  • Implement and maintain Databricks platform constructs for secure delivery, including catalogs, schemas, service principals, and job orchestration, and build CI/CD pipelines for data platform assets.
  • Apply data classification and segregation requirements within pipeline design, build data quality controls reflecting business meaning, and partner with teams to ensure reliable, governed data for downstream use.

Shield AI is a venture-backed defense-tech company founded in 2015 with the mission of protecting service members and civilians with intelligent systems, developing products like Hivemind autonomy software and V-BAT and X-BAT aircraft. The company has offices and facilities across the U.S., Europe, the Middle East, and Asia-Pacific, and its technology actively supports operations worldwide.

Global

  • Partner directly with enterprise customers to design, build, and scale data solutions that power business-critical applications.
  • Architect modern cloud-native data platforms using Databricks, ClickHouse, Python, and distributed processing frameworks.
  • Drive best practices in data governance, security, observability, and operational excellence across engineering teams.

Resilinc pioneers intelligent, autonomous systems for supply chain risk management, using agentic AI to help global enterprises predict disruptions and act in real time. The company is a fully remote, mission-led team with a collaborative culture, trusted by top companies in various industries.

$11,000–$165,000/yr
US 3w PTO

  • Lead support of client’s Azure Data platform and Power BI environment, including escalations and incident resolution.
  • Consult and advise on solutions using Synapse, Data Factory, Databricks, Azure ML, and Power BI for data engineering and analytics.
  • Mentor junior team members and design data pipelines, models, and AI-driven solutions for clients across industries.

3Cloud is a cloud services company specializing in Microsoft Azure data and analytics solutions. They foster a culture of experimentation, direct feedback, and collective growth, with a focus on client success and teamwork.

US

  • Design, build, and maintain scalable data pipelines and platform components for analytics, BI, data science, and AI.
  • Lead evolution of a Databricks-based Lakehouse platform, defining architecture, governance models, and engineering standards.
  • Provide senior technical leadership through architecture design, code quality standards, mentoring, and engineering decision-making.

Jobgether uses AI-powered matching to connect candidates with hiring companies. This role is for a partner company building a modern data and AI platform, fostering a collaborative and engineering-driven culture with emphasis on innovation and learning.

UK

  • Design and maintain scalable batch and near real-time data pipelines in Databricks, integrating data from various sources.
  • Build unified customer profiles and support identity resolution, deduplication, enrichment, and Golden Record creation.
  • Enable CRM and marketing teams to access trusted, activation-ready customer data with minimal latency.

Massive Rocket is a rapidly scaling Braze and Snowflake agency that transforms how digital marketing, product, and engineering teams connect. They have grown quickly in five years and are aiming for $100M in revenue, with a culture of ownership, collaboration, and growth.

$75,000–$115,000/yr
US

  • Build and maintain scalable data pipelines and models using Databricks, dbt, and SQL (PostgreSQL).
  • Develop robust data solutions leveraging AWS services (Redshift, RDS, S3, Glue, Lambda, etc.).
  • Implement data transformations and integrations using Python and Java.

Capital Technology Group provides expert consulting services in software development, digital transformation, human-centered design, data analytics, and cybersecurity. Recognized as a Top Workplace, CTG fosters a culture of trust, empowerment, and professional growth.

Global

  • Develop scalable backend systems and data pipelines using Python, PySpark, and SQL.
  • Build secure, containerized applications with Docker and cloud platforms.
  • Collaborate with cross-functional teams to deliver high-quality engineering solutions.

Resilinc is a supply chain intelligence company that uses agentic AI to help enterprises predict and mitigate disruptions. They are a fully remote, mission-led team with a collaborative culture.

US Unlimited PTO

  • Own day-to-day operations of Azure SQL Managed Instance environments including performance monitoring and troubleshooting.
  • Monitor, triage, and restart Azure Data Factory pipeline runs and troubleshoot integration failures.
  • Design and implement automation solutions using PowerShell, Python, or Azure-native tools to eliminate manual work.

EverOps is a premier Embedded Service Provider that partners directly with customer engineering and operations teams to address delivery and service issues in the DevOps and DataOps space. They have a dynamic team in a U.S.-Based Virtual Operating Center, fostering empowerment and mentorship.

$0–$215,000/yr
US Unlimited PTO

  • Lead, coach, and develop a global team of data engineers while guiding technical architecture and delivery.
  • Build and scale large-scale data pipelines, production datasets, and QA systems using Databricks, Airflow, SQL, and PySpark.
  • Partner with product and research teams to transform complex data into reliable, production-grade assets for customers and internal applications.

YipitData is a leading market research and analytics firm that analyzes billions of alternative data points to provide actionable insights for the disruptive economy. The company recently raised $475M, operates globally with offices in the US, APAC, and India, and has been recognized by Inc. as a Best Workplace for three consecutive years.

US

  • Collaborate with cross-functional teams to design and deliver scalable data solutions for the Unified Data Platform on Azure Fabric.
  • Build and optimize data pipelines, ETL/ELT processes, and ensure data quality and compliance with HIPAA and governance standards.
  • Work directly with researchers to translate requirements into technical designs and contribute to the evaluation of emerging technologies.

Emory University is a leading research university that fosters excellence and attracts world-class talent to innovate and prepare leaders for the future. It is a large academic institution with a collaborative culture focused on research, education, and community impact.