Source Job

UK

  • Lead the design and evolution of scalable data, analytics, and AI platforms for global customer operations.
  • Architect and optimize Databricks-based data pipelines and enterprise data platforms for unified intelligence.
  • Drive development of ML, NLP, Generative AI, and operational intelligence capabilities to improve customer experience.

Databricks Spark Python Machine Learning NLP

20 jobs similar to Lead Data & AI Platform Engineer

Jobs ranked by similarity.

$150,000–$180,000/yr
US

  • Design production data pipelines using Databricks Lakeflow, Autoloader, and Structured Streaming with CI/CD.
  • Architect Lakehouse solutions including medallion architecture and Unity Catalog for analytics and AI.
  • Collaborate with product and backend engineers to design data models and APIs that serve the product.

Livefront helps companies design and build world-class digital products. They have worked with major brands and startups, fostering a culture built on respect, mutual trust, and egoless collaboration.

North America

  • Lead and deliver end-to-end Databricks implementation projects at enterprise scale.
  • Design and architect Lakehouse Platform solutions aligned with client business needs.
  • Apply deep Apache Spark expertise to optimize distributed workloads and runtime performance.

We are a data infrastructure and analytics consulting practice specializing in Databricks implementations for enterprise clients. Our team is composed of experienced engineers and architects who prioritize production-grade quality and continuous learning.

Global

  • Serve as the technical lead and pillar head for Data Platform Engineering, defining and evolving the enterprise 10-Layer Data & AI Operating System.
  • Architect and deploy the centralized Metadata Control Plane and automated Data Catalog, driving GitOps and Data-as-Code practices.
  • Design and govern enterprise AI infrastructure standards, including Vector Databases, Knowledge Graphs, and RAG pipelines.

Avery Dennison is a global materials science and digital identification solutions company with locations in over 50 countries and approximately 35,000 employees worldwide. They foster a culture of curiosity and courage, encouraging diversity of thought and collaboration.

$180,000–$225,000/yr
Canada

  • Design and architect scalable Databricks-based solutions for enterprise clients.
  • Lead end-to-end cloud data platform implementations across AWS and/or Azure.
  • Partner directly with client stakeholders to understand business needs and translate them into technical solutions.

Cuesta Partners is a consulting firm that delivers data engineering solutions in a client-facing environment. They value entrepreneurship, humility, diversity, learning, speed, and balance, and offer a competitive compensation package.

Global

  • Architect enterprise-scale Databricks data platforms with guardrails, automation, and standards to enable safe self-service by business teams.
  • Design high-volume batch and real-time streaming pipelines using PySpark and Structured Streaming, integrating Unity Catalog with third-party metadata.
  • Communicate architectural decisions to technical and business stakeholders, produce documentation, and partner with client teams to translate use-case needs into platform capabilities.

Caylent is an AI-first cloud services company that helps organizations turn ambitious ideas into meaningful business impact using AWS, AI, and Anthropic's Claude platform. They are a fully remote global company with employees across Canada, the US, and Latin America, fostering a culture of technological curiosity and inclusion.

$152,300–$209,450/yr
US

  • Lead technical discovery and design solutions for customer workloads in data engineering, analytics, and ML.
  • Build and deliver compelling proofs-of-concept and live demos on the Databricks Platform.
  • Own frontline technical relationships with customer engineers and data teams to drive platform adoption.

Databricks is the Data and AI company. Over 20,000 organizations worldwide, including 70% of the Fortune 500, rely on its unified platform for data, analytics, and AI, with a culture of proactiveness and customer-centricity.

Global

  • Architect scalable data platforms for analytics, ML/AI products, and customer-facing data products.
  • Build reliable batch and near-real-time pipelines that are scalable and cost-efficient.
  • Productionize ML and AI products and support LLM/VLM workflows.

Vidmob is a creative data company that provides scoring software and analytics to help marketers improve creative effectiveness. It partners with the world's largest marketers and agencies and operates a robust human-reinforcement learning model for creativity.

Latin America

  • Design and optimize scalable data platforms, pipelines, and governance frameworks.
  • Lead data strategy and collaborate with leadership, engineering, and AI teams.
  • Mentor engineers and drive platform modernization with an AI-forward mindset.

Robots & Pencils is an applied AI engineering firm building AI co-workers for enterprise operations. Founded in 2009 with delivery centers in Canada, US, Eastern Europe, and Latin America, the company is a nimble alternative to traditional system integrators with teams averaging 15+ years of experience.

Global

  • Define strategic Databricks adoption roadmaps and platform guardrails for enterprise clients.
  • Embed with client teams to implement high-priority use cases, then guide them toward self-service.
  • Act as a data engineering SME in pre-sales and coach client teams on Databricks best practices.

Caylent is an AI-first cloud services company that helps organizations turn ambitious ideas into meaningful business impact. They are a fully remote global company with employees across Canada, the United States, and Latin America, fostering a culture of technological curiosity and inclusion.

Turkey

  • Define and drive overall Data and AI platform architecture using Databricks and lakehouse design patterns.
  • Architect secure LLM and Generative AI enablement capabilities, including RAG and agentic workflows.
  • Collaborate with engineering and business stakeholders to translate requirements into practical architecture solutions.

Latin America

  • Lead and mentor a team of Data Engineers, driving technical excellence and engineering best practices.
  • Own end-to-end architecture and design of the data platform, ensuring scalability and reliability.
  • Define and drive data migration strategies from Snowflake and SSIS to Azure Databricks and DBT.

Coforge is a global digital services and solutions provider specializing in data engineering and cloud transformation. With over 20,000 employees, it fosters a culture of innovation, collaboration, and technical excellence.

Brazil

  • Develop, adjust, and evolve data pipelines using Databricks and PySpark.
  • Analyze processes migrated from legacy systems (SAS, Hive, Teradata) and make necessary adjustments.
  • Identify bottlenecks and implement performance improvements and optimizations in pipelines and large-scale data processing.

CI&T helps large companies transform AI potential into real business impact with AI deployment, AI-native execution, and tech-integrated business solutions. With 30 years of experience and 8,000 employees across 25+ countries, we accelerate innovation through expertise in agentic SDLC, application modernization, Data & AI, martech, and business strategy.

Brazil

  • Design, develop, and maintain scalable data pipelines and infrastructure.
  • Collaborate with cross-functional teams to ensure data integrity and usability.
  • Implement data quality and governance practices within data pipelines.

We help large enterprises transform with AI and tech-integrated solutions. With 8,000 employees across 25+ countries, we collaborate to build solutions with real impact.

US Unlimited PTO

  • Design and implement modern data platforms using Microsoft Fabric and Databricks, building performant ELT/ETL pipelines and scalable lakehouse architectures.
  • Develop complex Power BI data models and visually compelling reports that drive measurable client decisions, ensuring data quality and usability.
  • Work directly with client stakeholders to gather requirements, provide expert guidance, and build strong relationships as a trusted technical advisor.

Collectiv is a boutique consulting and strategy firm specializing in Analytics, Planning, and AI with Power BI and the Microsoft Data Stack. They are a fully remote team with a growth mindset and a focus on helping enterprises make better decisions.

US

  • Lead the technical design and implementation of the RevOS data architecture within Databricks and the DHA War Data Platform.
  • Assess and restructure existing revenue-cycle data into a scalable, governed, and reusable data model aligned to the healthcare workflow.
  • Ensure the resulting data architecture directly supports production dashboards, KPI reporting, and drill-down analysis.

LMI is a digital solutions provider dedicated to accelerating government impact with innovation and speed. Headquartered in Tysons, Virginia, LMI serves the defense, space, healthcare, and energy sectors with a focus on agility and collaboration.

Mexico

  • Design and implement scalable data architectures to meet business needs.
  • Develop and optimize data pipelines for ingesting and processing large volumes of data.
  • Provide technical leadership and mentorship to junior engineers.

Oportun is a mission-driven financial services company that provides affordable credit and financial tools. Since inception, it has provided over $21.3 billion in credit and saved members $2.5 billion, and fosters a diverse, inclusive culture.

$150,000–$180,000/yr
US

  • Build and maintain data ingestion pipelines from enterprise systems and APIs.
  • Develop SQL and Python solutions for data transformation and curation.
  • Partner with analytics and engineering teams to deliver governed data products.

AHEAD builds and operates data capabilities to help teams access trusted information. The company fosters a product-oriented engineering culture with a focus on collaboration and AI-assisted development.

India

  • Work directly with business stakeholders across Warner Music Group to deliver rapid data and AI solutions.
  • Build full-stack solutions including data pipelines, backend Python, and dashboard apps using Streamlit, Databricks, and Snowflake.
  • Solve diverse problems across labels and global functions, turning weeks-long manual tasks into minutes.

Warner Music Group is a global collective of music makers, innovators, and entrepreneurs, home to labels like Atlantic, Warner Records, and Parlophone. With a catalog of over one million copyrights and a diverse team, they value curiosity, collaboration, and commitment.

Canada

  • Design and deliver scalable Databricks solution architectures for enterprise customers.
  • Lead technical discovery sessions and develop prototypes and proofs of concept.
  • Collaborate with engineering, data science, and business teams to translate technical concepts into business outcomes.

This company is a partner organization that designs and delivers modern data and AI platforms. It offers a remote-friendly work environment and a collaborative culture focused on innovation.

US

  • Own the technical portion of the sales cycle for Databricks opportunities from discovery to handoff.
  • Design architectures for lakehouse, medallion, data ingestion, transformation, and governance.
  • Partner with sales, alliance, and delivery teams to develop proposals and statements of work.

Aimpoint Digital is a market-leading data, AI, and analytics consulting firm. They help organizations design, build, and operationalize modern data platforms, analytics solutions, and production AI applications.