Join the Data Infrastructure team and play a pivotal role in upholding the reliability, scalability, and efficiency of our robust Data platform as a Senior Site Reliability Engineer. Collaborate closely with diverse cross-functional teams to oversee the foundational data infrastructure that empowers our array of applications and services. Implement data infrastructure solutions, utilize Infrastructure as Code principles, and maintain CI/CD pipelines.
Job listings
You'll join a specialized squad focused on map modeling and exporting services within an established infrastructure ecosystem. As a DevOps Engineer, you'll help leverage open-source tools while collaborating with a broader DevOps community to maintain and improve deployment pipelines across multiple cloud environments. Main responsibilities include supporting and optimizing the open-source data processing ecosystem and maintaining CI/CD pipelines for reliable, automated deployments.
In this role, you will address critical challenges such as efficiently operating and managing over 200 Kafka clusters, supporting and monitoring over 1 million Kafka topics, and handling over 1PB of data daily, ensuring minimal latency and high reliability.