Data Engineer

Primary Responsibilities:

• Design, build, test, and maintain scalable data pipelines and ETL/ELT processes for cloud-based data environments.
• Implement patient-matching and record-linkage logic across multiple identifiers for accurate Veteran data.
• Harmonize datasets across VA facilities, resolving structural and format inconsistencies.

Minimum Qualifications:

• 8+ years of relevant experience in data engineering with ETL/ELT pipelines and cloud data environments.
• BA/BS degree in Computer Science, Information Systems, or related technical field.
• Prior experience supporting federal agency programs; must be a U.S. citizen or authorized to work in the U.S.

Desired Qualifications:

• Hands-on experience with Azure Databricks and PySpark for large-scale distributed data processing.
• Proficiency in Python for pipeline automation and data wrangling within federal health data contexts.
• Experience developing Power BI reports and dashboards using Databricks SparkSQL.