Senior Data Pipeline Engineer

We are seeking a highly skilled Data Pipeline Engineer to join our dynamic Data Engineering team. Hired individuals will play a crucial role in helping to build out our data engineering team to support our strategic pipelines and optimize for reliability, efficiency, and performance. In this role, you’ll work closely with analysts, data engineers, and stakeholders to design, debug, and refine high-performance data pipelines in Databricks, while also helping to train and support internal users as the team’s responsibilities expand. You will report directly to the Senior Manager of Data Engineering, who will provide significant, hands-on training on cutting-edge data tools and techniques. You will design, build, and maintain reliable data pipelines that power key products and analyses. You will also detect and resolve performance bottlenecks using Spark UI, logs, and metrics. You will collaborate with analysts and other engineers to convert business requirements into scalable datasets. You will participate in code reviews, author clear documentation, and share learnings through demos and write-ups. You will continuously deepen your expertise in Databricks, Spark, and AWS by owning increasingly complex projects.