Big Data Engineer

As a Big Data Engineer at BrightEdge, you will design, build, and maintain high-performance data pipelines that process terabytes of data. You'll work on optimizing our existing systems, identifying and resolving performance bottlenecks, and implementing solutions that improve the overall efficiency of our platform. This role is critical in ensuring our data infrastructure can handle increasing volumes of data while maintaining exceptional performance standards. You will design and implement scalable batch processing systems using Python and big data technologies, optimize database performance, focusing on slow-running queries and latency improvements. The ideal candidate will use Python profilers and performance monitoring tools to identify bottlenecks and build efficient ETL pipelines that can handle large-scale data processing.