Data Engineer

As a Data Engineer, collaborate with Artificial Intelligence and Machine Learning team members to operationalize data pipelines and ML tasks. Provide day-to-day support for deploying Python-native ML pipelines. Implement efficient data ingestion strategies and change data capture mechanisms, leveraging Databricks and AWS services, to ensure real-time and accurate data updates for analytics and decision-making processes. Utilize Databricks to design, develop, and maintain scalable data pipelines, enabling efficient extraction, transformation, and loading (ETL) processes. Leverage Python programming expertise to enhance data processing scripts, ensuring robustness, efficiency, and maintainability in AWS Lambda environments. Execute data engineering tasks to facilitate AI/ML capabilities. Communicate results effectively to diverse audiences through presentations. Assist in architectural leadership, technical support, and advisement services to ensure integration of identity management system technologies meets security requirements.