Staff Software Engineer, Data Ingestion

The Staff Software Engineer, Data Ingestion will be a critical individual contributor responsible for designing collection strategies, developing, and maintaining robust and scalable data pipelines. This role is at the heart of our data ecosystem, deliver new analytical software solution to access timely, accurate, and complete data for insights, products, and operational efficiency. Key responsibilities include designing, developing, and maintaining high-performance, fault-tolerant data ingestion pipelines using Python. You will integrate with diverse data sources (databases, APIs, streaming platforms, cloud storage, etc.) and implement data transformation and cleansing logic during ingestion to ensure data quality. You will also monitor and troubleshoot data ingestion pipelines, identifying and resolving issues promptly. Collaboration with database engineers to optimize data models for fast consumption is required, as well as evaluating and proposing new technologies to improve ingestion efficiency and reliability. You will develop and implement self-healing mechanisms for data pipelines to ensure continuity. Define and uphold SLAs and SLOs for data freshness, completeness, and availability. Participate in on-call rotation as needed for critical data pipeline issues.