Technical Data Governance Specialist

You will be a lone wolf, responsible for both designing and, most critically, implementing the core components of our data governance framework from the ground up within our Databricks environment. Your primary mission is to rapidly transform our data landscape by inventorying, cataloging, and securing our data assets, directly enabling AI-powered self-serve analytics and ensuring the trustworthiness of our data. Key Responsibilities: Your mandate is to build, not just to plan. You will execute on the following priorities: Data Asset Inventory and Mapping: Dive deep into our source systems to conduct a comprehensive inventory of Plooto’s data assets. Collaborate with engineering teams to map data flows and document data lineage, establishing a clear picture of our data landscape. Develop and implement an initial game plan for the organization and pre-processing of raw data, aligning with our Medallion architecture principles. Data Catalog Implementation and Enrichment: Lead the hands-on implementation and operationalization of our data catalog using Databricks Unity Catalog . Systematically enrich the catalog with thorough and accurate annotations for all catalogs, tables, and fields, making data discovery intuitive and reliable. Ensure the catalog is meticulously maintained to serve as the single source of truth for our data assets, unlocking the potential for AI-powered analytics. Data Quality and Observability: Design and implement a practical data quality framework, creating and automating tests within the Azure and Databricks ecosystems. Establish an initial data observability platform, ensuring the quality and reliability of our most critical data pipelines. Work directly with data consumers to identify critical data elements and prioritize the rollout of quality monitoring. Access Control and PII Management: Implement and manage a robust access control framework within Databricks to ensure data is both accessible and secure. Develop and execute protocols for identifying, classifying, and protecting Personally Identifiable Information (PII) across the data lakehouse. Collaborate with Legal, Compliance, and Security teams to ensure technical implementations align with regulatory requirements like CCPA and GDPR.