You’ll be at the center of scaling Underdog’s real-time data platform, powering everything from pricing pipelines to ML-driven features. This is a high-impact role that bridges infrastructure, data engineering, and machine learning teams to define and deliver the next generation of Underdog’s platform.
About the role:
-Design and implement a new real-time data pipeline using Kafka or other queuing technologies, supporting data engineering and ML use cases
-Partner with the data engineering team to stream data directly from core app Postgres databases.
-Begin executing the migration path from Datastream to a queuing-based architecture
-Outline and drive execution steps for eventual cloud migration from GCP to AWS, leveraging cloud-agnostic technologies
-Build scalable load testing frameworks to stress test pricing engineering systems and validate autoscaling logic
-Integrate testing frameworks into deployment pipelines to ensure robustness in every release.
-Collaborate with Pricing Engineering (PE) and Data Engineering (DE) teams to develop a 6–12 month technical roadmap for shared platform initiatives
-Modularize Terraform and other infrastructure-as-code solutions to support both PE and DE teams consistently