Similar Jobs
See allETL Specialist
Trilogy Federal
US
SQL
Python
Azure Data Factory
Senior Data Engineer
Care Access
US
Databricks
SQL
Dbt
Lead Data Engineer
Oddball
United States
Databricks
Spark
Azure Data Factory
Senior DataOps Engineer
Redcare Pharmacy
Europe
Azure
Databricks
Apache Spark
Data Engineer
HarperCollins
US
SQL
Python
PySpark
Primary Responsibilities:
- Design, develop, and maintain scalable data ingestion and processing pipelines using Azure Data Factory, Azure Databricks, Apache Kafka, and related cloud technologies.
- Engineer and optimize data lakehouse solutions, including Delta Lake architectures, semantic models, conformed dimensions, and partitioning strategies.
- Implement automated data validation, reconciliation, and monitoring to ensure data accuracy and freshness.
Minimum Requirements:
- Bachelor's degree in Computer Science, Information Technology, Data Engineering, or related field with seven or more years of experience.
- Hands-on experience with Azure Data Factory, Azure Databricks, Apache Kafka, SQL, and Python.
- Experience with cloud-based lakehouse architectures, distributed data processing, and data modeling.
Preferred Qualifications:
- Experience supporting VA or other federal agency data modernization initiatives.
- Experience with Microsoft Azure Government cloud environments and Azure Synapse Analytics.
- Familiarity with federated query technologies and migrating complex legacy data warehouse workloads.
Benefits:
- Health, dental, and vision plans with optional FSA and paid parental leave.
- Safe Harbor 401(k) with employer contributions and paid time off plus 11 holidays.
- No cost group life/AD&D coverage with optional supplemental and pet insurance.
Trilogy Federal
Trilogy Federal drives innovative solutions for complex business challenges across financial management, healthcare, and government industries. Their collaborative, client-first service approach has earned them an unparalleled reputation for delivering transformative results.