Source Job

$130,000–$150,000/yr
US 4w PTO

  • Data Ingestion & Pipeline Reliability: Ensuring continuous, accurate data availability by monitoring and optimizing batch and real-time streaming pipelines.
  • Data Mart Delivery & Business Modeling: Delivering query-ready Gold-layer data marts by partnering with Data Analytics and Data Science teams.
  • Data Quality Frameworks & Precision: Maintaining flawless data integrity by writing and deploying automated data quality test suites.

Databricks PySpark Azure ETL/ELT Data Quality

20 jobs similar to Data Engineer

Jobs ranked by similarity.

$140,000–$210,000/yr
US

  • Design and build ingestion pipelines from enterprise source systems into the Databricks lakehouse using Delta Lake, owning Bronze-layer ingestion and building Silver-layer pipelines for cleansing and standardization.
  • Implement and maintain Databricks platform constructs for secure delivery, including catalogs, schemas, service principals, and job orchestration, and build CI/CD pipelines for data platform assets.
  • Apply data classification and segregation requirements within pipeline design, build data quality controls reflecting business meaning, and partner with teams to ensure reliable, governed data for downstream use.

Shield AI is a venture-backed defense-tech company founded in 2015 with the mission of protecting service members and civilians with intelligent systems, developing products like Hivemind autonomy software and V-BAT and X-BAT aircraft. The company has offices and facilities across the U.S., Europe, the Middle East, and Asia-Pacific, and its technology actively supports operations worldwide.

US Canada

  • Build and maintain batch data pipelines ingesting from Workday and legacy systems into a medallion lakehouse on Azure Databricks and Microsoft Fabric.
  • Develop transformation logic across Bronze/Silver/Gold layers using Spark, Python, and SQL, and implement data-quality checks.
  • Work within a federated architecture and Unity Catalog security model, contributing to documentation and code reviews.

CampusWorks is a consulting firm that helps higher education institutions leverage technology and managed services to drive transformation and student success. Founded in 1999, it is a large, virtual company with a culture that values work-life balance and employee appreciation.

Global

  • Design, develop, and maintain data pipelines using Azure Databricks.
  • Build and optimize data transformations using PySpark and SQL in Databricks.
  • Implement and maintain Lakehouse architectures using Delta Lake.

Miratech helps visionaries change the world. We are a global IT services and consulting company with nearly 1000 full-time professionals and a culture of Relentless Performance.

Canada

  • Design, build, and maintain scalable data pipelines and ETL/ELT processes using Databricks and Spark.
  • Architect and optimize data models and storage solutions for analytics and operational use.
  • Implement observability, alerting, and data quality monitoring for critical pipelines.

Sonatype provides end-to-end software supply chain security solutions, protecting against malicious open source and managing SBOMs. With over 2,000 organizations and 15 million developers using its platform, it focuses on innovation and security in software development.

Latin America

  • Own end-to-end delivery of data pipelines and data products from design through deployment and production support.
  • Develop and optimize scalable data pipelines using Azure Databricks, DBT, and Python.
  • Support large-scale data migrations from Snowflake to Azure Databricks and manage infrastructure with Terraform.

Coforge is a global IT solutions company that provides digital services and solutions to enterprises. They employ thousands of professionals worldwide and focus on innovation and collaboration.

UK

  • Design and maintain scalable batch and near real-time data pipelines in Databricks, integrating data from various sources.
  • Build unified customer profiles and support identity resolution, deduplication, enrichment, and Golden Record creation.
  • Enable CRM and marketing teams to access trusted, activation-ready customer data with minimal latency.

Massive Rocket is a rapidly scaling Braze and Snowflake agency that transforms how digital marketing, product, and engineering teams connect. They have grown quickly in five years and are aiming for $100M in revenue, with a culture of ownership, collaboration, and growth.

Latin America

  • Lead and mentor a team of Data Engineers, driving technical excellence and engineering best practices.
  • Own end-to-end architecture and design of the data platform, ensuring scalability and reliability.
  • Define and drive data migration strategies from Snowflake and SSIS to Azure Databricks and DBT.

Coforge is a global digital services and solutions provider specializing in data engineering and cloud transformation. With over 20,000 employees, it fosters a culture of innovation, collaboration, and technical excellence.

Global

  • Architect enterprise-scale Databricks data platforms with guardrails, automation, and standards to enable safe self-service by business teams.
  • Design high-volume batch and real-time streaming pipelines using PySpark and Structured Streaming, integrating Unity Catalog with third-party metadata.
  • Communicate architectural decisions to technical and business stakeholders, produce documentation, and partner with client teams to translate use-case needs into platform capabilities.

Caylent is an AI-first cloud services company that helps organizations turn ambitious ideas into meaningful business impact using AWS, AI, and Anthropic's Claude platform. They are a fully remote global company with employees across Canada, the US, and Latin America, fostering a culture of technological curiosity and inclusion.

$128,000–$145,200/yr
US

  • Build, maintain, and optimize scalable data infrastructure for AI/ML features.
  • Partner with ML Engineers, Data Scientists, and Software Engineers to transform healthcare data into high-quality datasets.
  • Contribute to data pipelines, improve data quality, and ensure reliable, performant, and well-governed data for AI systems.

Tebra is the only all-in-one EHR+ platform built exclusively for independent healthcare practices. More than 42,000 private practices trust Tebra to streamline operations, increase revenue, and reduce burnout, with a culture that values starting with the customer, keeping it simple, staying entrepreneurial, being better together, and celebrating success.

Latin America

  • Design and maintain DBT models on Azure Databricks using Delta Lake and Medallion Architecture.
  • Leverage AI-assisted development tools for model generation, refactoring, and testing.
  • Enforce data contracts, governance standards, and data observability practices.

Coforge is a global IT services company specializing in digital transformation solutions. They have a large workforce and prioritize a collaborative, skills-based culture.

US

  • Design and develop end-to-end data pipelines using Azure Data Factory and Synapse Pipelines.
  • Manage Azure Databricks workspaces and clusters, optimizing Spark jobs for performance.
  • Automate infrastructure and deployments with Bicep and Azure DevOps CI/CD pipelines.

Quisitive is a global Microsoft partner specializing in cloud transformation, data strategy, cybersecurity, and agentic AI. With significant growth since 2016, the company has expanded across the US, Canada, and India, fostering a culture of craftsmanship and collaboration.

$112,000–$179,000/yr
US

  • Build out and configure a dedicated Government Databricks workspace within the existing environment
  • Design and implement data ingestion pipelines from core agency systems including financial, HR, CRM, and ITSM
  • Implement Databricks Unity Catalog for centralized data governance, metadata management, and end-to-end lineage tracking

Peraton is a next-generation national security company that drives missions of consequence globally. As a leading mission capability integrator and enterprise IT provider, the company serves essential government agencies and supports every branch of the U.S. armed forces.

Brazil

  • Own and evolve notebooks across the full medallion architecture, from raw ingestion through a fully modeled dimensional layer.
  • Design and implement dimensional modeling artifacts such as facts, dimensions, and slowly changing dimensions for downstream business intelligence.
  • Serve as the primary technical reference, reviewing pull requests, mentoring team members, and proposing architectural improvements.

CI&T helps large enterprises transform the potential of AI into real business impact with AI Deployment, AI-native execution, and tech-integrated business solutions. With 30 years of experience and 8,000 employees across 25 countries, we foster a collaborative culture that accelerates innovation in Agentic SDLC, Application modernization, Data & AI, Martech, and Business strategy.

Poland

  • Design, build and maintain scalable ingestion and transformation pipelines across Microsoft Fabric and Azure Synapse Analytics.
  • Develop dimensional and medallion-layer data models, and optimize queries and semantic models for performance.
  • Act as line manager to junior data engineers, providing technical guidance, mentoring, and performance management.

Morgan Advanced Materials uses advanced ceramic and carbon materials to solve difficult problems for customers across diverse markets. Founded in the UK in 1856, the company has grown into a global organization with 70 sites in 18 countries, approximately 8,000 employees, and revenue of £1,100.7m in 2024.

Mexico

  • Design and deliver complex data platform components or migration solutions on AWS using Databricks.
  • Troubleshoot performance, scalability, and reliability issues in cloud-native data environments.
  • Communicate technical topics clearly to stakeholders and produce high-quality documentation.

Caylent is an AI-first cloud services company that helps organizations turn ambitious ideas into meaningful business impact. As a fully remote global company with employees in Canada, the United States, and Latin America, they celebrate diverse cultures and foster a community of technological curiosity.

Ukraine

  • Design and build batch data pipelines that ingest, validate, and transform multi-billion-row datasets.
  • Model complex real-world data including dimensional models and temporal data.
  • Develop and operate workloads on lakehouse platforms like Databricks, Spark, and Delta.

Simulmedia builds an advanced TV and streaming advertising platform. They have a team of engineers, data scientists, and designers who are obsessed with building cutting-edge technology.

US

  • Provide thought leadership, mentor junior staff, and deliver design artifacts for each sprint.
  • Build and support enterprise data integrations with ETL workflows using Azure Databricks, Data Factory, and Synapse.
  • Collaborate with global teams to ensure scalable, performant, and secure data solutions aligned with enterprise architecture.

QVC Group is a Fortune 500 live social shopping company with six leading retail brands that redefine the shopping experience through video-driven commerce. They have team members across the U.S., U.K., Germany, Japan, Italy, Poland, and China, fostering an inspired, diverse, and collaborative culture.

$115,000–$175,000/yr
US Unlimited PTO

  • Own the Airflow codebase end-to-end, building reusable templates and enforcing standards.
  • Build and extend large-scale Spark pipelines on AWS Glue and support migration to Databricks.
  • Drive data model improvements around commercial pharma data with focus on structure and lineage.

Veeva Systems is a mission-driven organization and pioneer in industry cloud, helping life sciences companies bring therapies to patients faster. As one of the fastest-growing SaaS companies in history, it surpassed $3B in revenue and values doing the right thing, customer success, employee success, and speed.

Brazil

  • Design, develop, and maintain scalable ETL/ELT pipelines
  • Build and optimize data processing solutions using Python and Apache Spark
  • Develop and support real-time data streaming applications using Kafka

Sigma Software develops modern digital solutions for global businesses. They foster an international remote-first environment where engineers can grow, innovate, and influence technical decisions.

Brazil

  • Design, develop, and maintain scalable ETL/ELT pipelines in Azure environments.
  • Build and optimize Data Lake and Data Warehouse solutions to support analytics and business intelligence.
  • Implement data quality validation, monitoring, and governance to ensure reliable and trustworthy data.

CI&T helps large enterprises transform the potential of AI into real business impact with AI deployment, AI-native execution, and tech-integrated business solutions. With 30 years of experience and 8,000 employees across more than 25 countries, they combine human expertise with AI to build scalable and innovative technology solutions.