Job Description
As a Senior Data Engineer, you will design, develop, and maintain scalable ETL/ELT data pipelines for AI and analytics applications. Optimize data architectures and storage solutions using Databricks, Snowflake, and cloud-based platforms. Develop big data processing jobs using PySpark, Spark SQL, and distributed computing frameworks. Ensure data quality, governance, and security best practices across all environments. Implement CI/CD workflows for automated deployment and infrastructure as code (IaC). Collaborate with cross-functional teams (data scientists, software engineers, analysts) to build end-to-end data solutions. Lead troubleshooting and performance tuning efforts for high-volume data processing systems. Develop and maintain Python-based backend services to support data infrastructure. Implement Apache Airflow, Dataplane, or similar orchestration tools to automate and monitor workflows.
About Montevideo Labs
Montevideo Labs | A Blend Company helps organizations leverage data and technology to make better decisions with over 10 years of experience in the field of big data.