Senior Principal Data Engineer

Responsibilities:

• Own the technical evolution of the data engineering capabilities and be responsible for ensuring solutions are being delivered incrementally, meeting outcomes, and promptly escalating risks and issues
• Establish a deep understanding of how things work in data engineering, use this to direct and coordinate the technical aspects of work across data engineering, and systematically improve productivity across the teams.
• Maintain a high bar for operational data quality and proactively address performance, scale, complexity and security considerations.

Qualifications:

• You have 12+ years of experience in a Data Engineer role as an individual contributor.
• You have at least 3 years of experience as a tech lead for a Data Engineering team.
• You are an engineer with a track record of driving and delivering large (multi-person or multi-team) and complex efforts.

Experience:

• Experience with building streaming pipelines with a micro-services architecture for low-latency analytics.
• Experience working with varied forms of data infrastructure, including relational databases (e.g. SQL), Spark, and column stores (e.g. Redshift)
• Experience building scalable data pipelines using Spark using Airflow scheduler/executor framework or similar scheduling tools.