Source Job

$170,000–$190,000/yr
US

  • Lead technical direction and mentor engineers in modular Python development and SQL optimization.
  • Architect and optimize high-throughput ETL/ELT workflows using Databricks and Python/PySpark.
  • Collaborate with government stakeholders to translate complex defense requirements into scalable data pipelines and actionable insights.

Databricks Python PySpark SQL Data Visualization

20 jobs similar to Lead Data Engineer

Jobs ranked by similarity.

US

  • Lead migration of legacy SQL Server and ADF pipelines to Databricks Lakehouse, designing Bronze, Silver, and Gold layers.
  • Build scalable ETL/ELT frameworks using PySpark, Delta Live Tables, and Databricks Workflows, optimizing for Power BI.
  • Establish governance, security, and cost optimization standards, including Unity Catalog and monitoring dashboards.

Tier One Technologies is a technology services provider delivering data engineering, cloud migration, and consulting solutions to US Government clients. The company fosters a collaborative, detail-oriented culture focused on technical excellence and knowledge transfer.

India

  • Lead the design and implementation of scalable data architectures for member communications, defining data models, contracts, and lineage.
  • Build and optimize production-grade data pipelines using Databricks, Apache Spark, PySpark, and SQL, ensuring reliability and performance.
  • Establish data-quality and governance practices, and partner with Privacy, Compliance, and Risk teams to manage sensitive member data securely.

Oportun is a mission-driven financial services company that provides responsible credit and savings to help members build a better financial future. Since inception, it has provided over $22.7 billion in credit and saved members more than $2.5 billion in interest and fees, reflecting a culture focused on impact and innovation.

$130,000–$160,000/yr
US

  • Lead migration of the data platform to a modern Databricks lakehouse built on dbt, replacing legacy systems.
  • Build ELT pipelines with Databricks, dbt, and Fivetran to deliver curated, AI-ready datasets.
  • Mentor engineers, set technical standards, and partner with data science and AI teams.

Buildertrend is a leading residential construction management platform that helps contractors control financials, schedules, workflows, and client relationships in one system. With nearly two decades of industry expertise, the company fosters a culture of work-life balance and personal growth.

$140,000–$170,000/yr
US 5w PTO 16w maternity 16w paternity

  • Contribute to the design, implementation, automation, and support of enterprise-scale cloud data platforms using Databricks, AWS, and Infrastructure as Code.
  • Lead the design and development of ETL/ELT pipelines within Databricks using PySpark, Spark SQL, Delta Lake, and Databricks Workflows.
  • Build, deploy, and monitor ML models and data infrastructure to ensure high availability, scalability, and performance.

Scout Motors is an automotive company reviving the iconic Scout vehicle as an electric pickup truck and rugged SUV brand. The company fosters an inclusive, entrepreneurial culture focused on innovation, respect, and building from the ground up.

$89,300–$193,400/yr
US

  • Translate business and stakeholder needs into scalable data engineering and data science solutions.
  • Partner with cross-functional teams to understand requirements, prioritize opportunities, and deliver data-driven outcomes.
  • Build and maintain ETL pipelines, data integrations, and technical documentation for data assets.

Stryker is a leading medical technology company driven to make healthcare better, offering innovative products in orthopaedics, medical and surgical, and neurotechnology. Named one of the World's Best Workplaces, it is a large global organization focused on improving patient and hospital outcomes.

$180,000–$270,000/yr
Global

  • Lead the Enterprise Data delivery team, including data engineers and analytics engineers, to turn strategy into reliable data products.
  • Establish delivery rhythms, manage priorities, and ensure business needs translate into scoped, production-ready work.
  • Partner with technical leads to align domain delivery with platform standards and drive continuous improvement.

Shield AI is a venture-backed defense-tech company developing intelligent systems to protect service members and civilians. With offices across the U.S., Europe, the Middle East, and Asia-Pacific, the company's technology supports global operations.

$138,942–$218,550/yr
Global

  • Lead high-impact, company-wide data initiatives and mentor junior engineers to foster technical excellence.
  • Design and architect scalable data solutions, including ELT/ETL pipelines and optimized data models.
  • Ensure data quality and platform stability through rigorous frameworks and on-call support.

Atlassian is a software company that creates collaboration tools like Jira and Confluence to help teams work together. With a global workforce and a culture centered on teamwork and flexibility, Atlassian empowers employees to do their best work.

Data Engineer

Cisco
$103,200–$146,800/yr
US Unlimited PTO

  • Design, build, and maintain robust data pipelines that ingest and normalize security data from 120+ sources.
  • Operate and improve the attribution layer by implementing entity resolution and ownership rules as version-controlled code.
  • Collaborate with analysts and leadership to provide query support, reporting, and executive metrics that drive security program decisions.

Cisco designs and sells networking, security, and collaboration technologies that power the digital world. With a global team of doers and experts, we foster a collaborative culture that values empathy, innovation, and large-scale impact.

$25,236–$43,418/yr
India

  • Architect scalable data solutions using Databricks, Azure Fabric, PySpark, and SQL.
  • Build and automate end-to-end data pipelines with Azure Data Factory and CI/CD practices.
  • Mentor junior engineers and partner with stakeholders to align data engineering with business objectives.

Alimentiv is a healthcare technology and clinical research organization supporting gastrointestinal clinical trials and data-driven innovation. It operates with a collaborative global team and a focus on quality, compliance, and technical excellence.

India

  • Support client engagements as a project team member, translating business and technical requirements into data solutions.
  • Develop data pipelines and ETL/ELT processes on Snowflake, Databricks, AWS, and Azure for modern data platforms.
  • Contribute to code reviews, testing, documentation, and data governance while building consulting skills.

We help organizations unlock the full value of their data, turning complexity into clarity and measurable outcomes. FormativGroup is a collaborative team of specialists enabling middle-market companies to take full advantage of technology investments across cloud, AI, and data strategy.

US

  • Collaborate with sales and field engineering teams to accelerate adoption and growth of the Databricks platform.
  • Serve as the post-sale technical lead, driving onboarding, enablement, go-live, and healthy consumption for strategic accounts.
  • Manage executive relationships and create execution plans to maximize customer ROI across Data and AI use cases.

Databricks is the Data and AI company, providing a unified platform for data engineering, analytics, and AI. With more than 20,000 organizations worldwide and 30+ offices, Databricks offers a collaborative and inclusive culture with comprehensive benefits.

US Colombia

  • Become a trusted data and AI advisor, translating business questions into AI-ready data architectures.
  • Design and implement AI-optimized data platforms, including cloud data warehouses, lakehouses, ETL/ELT pipelines, and semantic layers.
  • Engineer modern data pipelines and models, writing production-ready code in SQL, Python, and Spark with Git and CI/CD best practices.

Aimpoint Digital is a fully remote AI and Data consultancy that partners with clients to design end-to-end analytical solutions and AI-ready data architectures. The company is a dynamic, growing team that blends modern tools with proven principles to deliver optimal data engineering outcomes.

US

  • Design and build production-grade analytical data models using dbt and Databricks, focusing on scalable Gold-layer architectures.
  • Develop semantic models and reusable data products that provide consistent metrics for consumption through Tableau and other BI tools.
  • Automate data workflows with Python and SQL, applying software engineering practices like Git and CI/CD.

NationsBenefits is a Healthcare Fintech provider of supplemental benefits, flex cards, and member engagement solutions for managed care organizations. The company is recognized as one of the fastest-growing in America, with a collaborative culture and offices in the US, South America, and India.

Global

  • Design, build, and maintain scalable ETL pipelines using PySpark and Databricks.
  • Optimize data pipelines for performance, cost-efficiency, and data quality best practices.
  • Collaborate with engineering and business teams to deliver robust data solutions.

Truelogic is a nearshore staff augmentation provider delivering technology solutions to companies of all sizes. With a team of 600+ tech professionals across Latin America, they foster a dynamic culture focused on career growth.

Data Engineer

540
US Unlimited PTO

  • Design, build, and maintain scalable data pipelines supporting the modernization of U.S. Army financial systems.
  • Develop Python-based workflows and cloud-native solutions using AWS services like Glue, Lambda, S3, and CloudWatch.
  • Collaborate with cross-functional teams to translate business and mission requirements into reliable, secure data solutions.

540 is a forward-thinking technology company that builds impactful solutions for government clients, including modernizing legacy systems for the U.S. Army. The culture is self-starting, innovative, and focused on breaking down barriers to get things done.

$145,000–$160,000/yr
US

  • Lead and oversee complex data engineering projects, bridging technical gaps and navigating ambiguous conditions.
  • Collaborate across teams to align data engineering efforts and translate technical concepts for less technical colleagues.
  • Mentor data team members and ensure large engineering projects deliver business outcomes.

Velir is an established mid-sized digital agency serving clients from non-profits to Fortune 500 brands, and acquired Brooklyn Data Company, a data and analytics consultancy. The company is remote-first with a culture built on trust, collaboration, and continuous improvement, offering competitive pay and benefits.

Global

  • Design, develop, and maintain scalable data pipelines, ETL/ELT workflows, and data integration processes for enterprise reporting and analytics.
  • Build and optimize data transformation solutions using Python and SQL, integrating data from multiple sources while ensuring quality, lineage, and reliability.
  • Support cloud-based data solutions on Azure and contribute to platform modernization initiatives including Microsoft Fabric and Lakehouse architectures.

Marlabs is a global AI and Digital Solutions Consulting firm that delivers intelligent solutions across AI, data, analytics, and product engineering. Since 2000, we have partnered with major healthcare, life sciences, financial services, and government organizations worldwide, and we foster an innovative, dynamic team.

India

  • Lead customer technical projects to deliver production-grade data and AI solutions on the Databricks platform.
  • Design and architect end-to-end systems spanning data engineering, AI, and application development.
  • Work hands-on with customers, guiding architecture and empowering adoption through training and implementation.

Databricks is the data and AI company, offering a unified platform for data engineering, analytics, and AI. With more than 20,000 customers including 70% of the Fortune 500, the company is headquartered in San Francisco with 30+ offices globally.

Colombia

  • Build and maintain reliable data pipelines and ETL/ELT workflows.
  • Develop and optimize data models for analytics and internal tools.
  • Monitor data pipelines for quality, performance, and reliability.

Sonatype is the software supply chain security company, providing end-to-end software supply chain security solutions and enterprise-grade SBOM management. More than 2,000 organizations, including 70% of the Fortune 100 and 15 million developers, rely on Sonatype, and the company values clarity, learning, and autonomy.

$130,000–$175,000/yr
US

  • Liaise with business stakeholders to identify data-driven projects and opportunities.
  • Develop dbt models using SQL expertise and manage Airflow tasks and scheduling.
  • Mentor team members and oversee analysis to ensure data and insights are accurate.

PENN Entertainment is North America's leading provider of integrated entertainment, sports content, and casino gaming experiences. With locations throughout North America, it offers a fun, relaxed work environment and supports career growth.