Design, build, and optimize scalable data platforms in a modern cloud environment. Involve hands-on development of ETL/ELT pipelines and data quality automation. Implement governance frameworks supporting analytics, BI, and ML use cases.
Remote Data Jobs · Python
418 results
FiltersJob listings
Perform analysis on structured and unstructured data sets. Develop solutions for targeted business needs. Implement models to uncover patterns and predictions creating business value and innovation.
Looking for a Senior Data Engineer with expertise in Azure and SQL to build and optimize data solutions. Engage directly with clients, translating business needs into technical solutions. Ensure best practices across data architecture, governance, and performance.
- Design and refine client-specific prompts, ensuring accuracy and relevance.
- Improve prompts for clarity and performance, automate testing with scripts.
- Work with Customer Success and Data Science teams, maintaining clear documentation.
- Develop machine learning applications to support the new digital testing platform.
- Create insights from existing data and drive the collection of new data.
- Help the team break down the work into manageable tasks and support Agile maturity.
- Contributes to data analytics, data operations, and software product development.
- Supports existing data operations such as data refresh ETL and data structure development.
- Develops new products using data centric DevOps concepts to inform requirements and creation of APIs.
Design, develop and optimize ETL pipelines using PySpark, Hive and Airflow for large-scale data processing. Build and maintain data lakes using Delta Lake, ensuring data reliability, quality, and integrity. Monitor, troubleshoot, and improve pipeline performance, scalability, and reliability.
Analyze health insurance claims, policy, and customer data to identify trends. Support data-driven decision-making for stakeholders. Extract, analyze, visualize, and present data.
- Design and build large-scale distributed data pipelines using various technologies.
- Develop ETL/ELT workflows on GCP integrating multiple data sources.
- Implement observability, monitoring, logging, and error-handling within pipelines.
The Customer Solution Architects (CSA) are integral in helping customers through all three phases of their journey - Onboarding, Adoption and Innovation. The CSA team works closely with the Customer Success Manager as well as Customer teams to onboard customers onto Atlan, drive Atlan adoption through Value Streams and use the power of Active Metadata to automate and innovate. As part of the the CSA team, you will build expertise in tools in the Modern Data Stack and be the trusted advisor to help and guide Customer stakeholders.