Senior/Master Data Developer

Responsibilities:

• Refactor legacy Databricks notebooks into modern ELT patterns, using declarative SQL for standard cases and Python for complex logic.
• Preserve data contracts through trusted-core layering and reverse-view strategies, ensuring no breaking changes.
• Develop parameterized YAML configurations for scalable ingestion pipelines with automated DAG generation.
• Implement data quality checks (synchronous and unit-level) for null prevention, key uniqueness, and domain validation.

Requirements:

• Strong hands-on Python, PySpark, and SQL for large-scale distributed processing.
• Experience migrating data lakes and refactoring legacy code (e.g., Databricks, ADF) into cloud-native components.
• Mastery of GCP data engineering tools: BigQuery, Dataform, Dataproc Serverless.
• Solid understanding of Medallion Architecture and data modeling (Star Schema, One Big Table).
• Proficient with GitOps (code review, PRs) and orchestration with Airflow/Composer.

Nice to Have:

• Experience using Generative AI agents (Gemini, Vertex AI, Claude) for code refactoring automation.
• Prior experience with Change Data Capture (CDC) and event-driven ingestion.
• Strong BigQuery performance tuning skills.
• Deep knowledge of Data Vault vs. Star Schema boundaries.

Benefits:

• Health and dental plans.
• Meal and food allowances.
• Childcare assistance.
• Extended parental leave.
• Gym partnership via Wellhub.
• Profit sharing (PLR).
• Life insurance.
• Continuous learning platform.
• Discount club.
• Online wellness platform.