Job Description
This role involves working with cutting-edge technologies including 3D simulation platforms, real-time data integration, and advanced optimization tools. Responsibilities include designing, developing, and maintaining data pipelines supporting geospatial and optimization workflows; integrating data sources such as Apache Kafka, S3, and others into simulation environments; and developing and optimizing real-time pipelines using tools like Apache Spark and Databricks. Further responsibilities include implementing and customizing optimization algorithms or modules (e.g., CuOpt, Gurobi, CPLEX) for enhanced system performance, collaborating with cross-functional teams to deliver impactful simulation and decision-making tools, and analyzing and improving system performance and scalability. The Data Engineer will also work with cloud platforms (AWS, Azure) to deploy and manage data and optimization solutions and maintain geospatial databases using tools like PostGIS and ArcGIS.