Lead Data Engineer

Lead the development and enhancement of a secure, scalable, and efficient data platform for a high-profile government client. This role is pivotal in designing and delivering batch and real-time data processing solutions using both commercial and open-source technologies. As a technical leader, you maybe responsible for leading data engineering efforts, mentoring junior engineers, and ensuring data architecture aligns with business and compliance requirements. You’ll work across diverse data sources and formats to deliver clean, reliable, and accessible data to downstream consumers, enabling critical analytics and operational insights. Architect, build, and maintain robust, scalable data pipelines to ingest, transform, and store data from multiple structured and unstructured sources. Lead the design and development of new data solutions, ensuring alignment with business goals and data governance policies. Conduct and guide logical and physical database design, data modelling, and performance tuning. Collaborate closely with cross-functional teams including data scientists, analysts, DevOps, and software engineers. Troubleshoot and perform root cause analysis of data issues and production bottlenecks. Drive best practices in code quality, testing (TDD), version control, and CI/CD across data engineering processes.