Senior Data Engineer

About Railroad19:

• We develop customized software solutions and provide software development services.
• We are a specialized team of developers and architects with a culture of hard work and industry leadership.
• We value our employees and provide the tools needed to succeed, with a 100% remote environment.

Core Responsibilities:

• Design and implement the UniForm write layer (Delta + Iceberg dual metadata).
• Build GCS → BigQuery ingestion pipelines for structured operational datasets.
• Develop and implement in Python and Spark, including Kafka-based CDC patterns for real-time and near-real-time ingestion.

Skills/Experience:

• 6+ years of enterprise-level experience in Python & Spark.
• Advanced experience in GCP BigQuery and strong working knowledge of Apache Iceberg, Delta Lake, and Iceberg UniForm.
• Experience with Delta Sharing, Kafka/CDC pipelines, and Snowflake Horizon Catalog.

Preferred Experience – Nice to Have:

• Prior delivery in enterprise SaaS, media, or advertising technology.
• Active daily use of AI-assisted development tools (Claude Code preferred).