Data Operations Engineer II

Role Overview:

• Build, monitor, and maintain data ingestion processes and systems across platforms.
• Develop and optimize complex scripts for automation and monitoring.
• Own the operational state of data pipelines, including incident response and maintenance.

Key Technologies:

• Python, PowerShell, Bash for scripting and automation.
• Azure, Databricks, Snowflake, SQL Server for data management.
• GitHub Actions, Azure DevOps for CI/CD pipelines.

Operational Responsibilities:

• Administer managed file transfer platforms like GoAnywhere.
• Build end-to-end monitoring and alert systems for pipeline health.
• Create comprehensive documentation and contribute to runbooks.

Collaboration and Growth:

• Work with cross-functional teams in an Agile environment.
• Share knowledge and engage in informal coaching.
• Independently plan and prioritize work to meet deadlines.