Databricks Engineer

Be part of a team that is supporting the Centers for Medicare and Medicaid Services (CMS) by disseminating data to researchers who are studying ways to improve the quality and reduce the cost of care provided to chronically ill Medicare beneficiaries. Design, implement, and support the Databricks platform that will encompass technical and functional aspects, high availability, performance and manageability. Build and maintain Extract, Transform, Load (ETL) processes for data integration and transformation. Monitor data pipelines, identify issues, and implement solutions to ensure reliable data processing. Implement methods and techniques to transform data for various use cases, including data analysis and machine learning. Work with data scientists, analysts, and business users to understand their needs and deliver data solutions. Ensure Databricks platform is operated in a secure way, ensuring that identified vulnerabilities are addressed promptly.