Similar Jobs
See allSenior Technical Product Manager
Smile Digital Health
US
Apache Spark
Databricks
Product Management
Senior Data Engineer
Veeva Systems
US
Python
SQL
Apache Airflow
Data Architect
Privia Health
US
Snowflake
Dbt
Python
New Senior Data Architect - Databricks Platform
Caylent
Global
Databricks
AWS
PySpark
Data Engineer
CampusWorks
US
Apache Spark
Python
SQL
Responsibilities:
- Lead the product vision and roadmap to decouple core data ingestion modules into scalable micro-services with event-driven streaming pipelines.
- Define requirements for transitioning analytics pipelines onto Databricks Medallion Architecture using Apache Spark and optimize Silver and Gold layer datasets.
- Own the product requirements for FHIR-native MDM Engine, defining survivorship logic and crosswalk management for millions of patient records.
Must have Experience:
- 5+ years of Technical Product Management experience leading complex backend data platforms or big-data ingestion systems.
- Proven track record productizing solutions with Apache Spark and distributed data processing frameworks.
- Deep familiarity with Medallion Architecture, Delta Lake, and OLAP columnar strategy for nested data structures.
Nice-to-Have Experience:
- Experience with healthcare data standards such as HL7 FHIR, C-CDA, or HL7 v2.
- Exposure to healthcare terminologies like SNOMED CT, LOINC, RxNorm, ICD-10.
- Familiarity with SQL-on-FHIR analytics standards.
Smile Digital Health
Smile Digital Health provides a FHIR-based data liberation platform for healthcare data exchange. The company was ranked #19 on Deloitte's Technology Fast 50 in 2024 and fosters a culture of diversity, equity, and inclusion.