Job Description
As a Data Engineer you will help build and maintain the foundations of the infrastructure, monitoring, security and operation of the company's Data and AI Platform - a.k.a. Dataflash. For this mission it will be necessary to consolidate partnerships with other engineering, analysis and data science teams, ensuring that our pipelines are increasingly scalable, secure and resilient - all in a simple way to effectively democratize Big Data and AI for everyone. Responsibilities include development of documentations to automations of workflows to improve the work with data of all at Flash, IaC management of the Cloud infrastructure in AWS, GCP, Databricks, CircleCI, GitHub services, ensure the scale of batch/streaming pipelines while keeping costs under control, create data pipelines for ingesting and processing various data sources (APIs, SQL and NoSQL Databases, and evolve the company's AutoML toolset and MLOps and LLMOps infrastructure.
About Flash
A Flash é uma Startup RHTech Brasileira, unimos tecnologia, pessoas e inovação para transformar a maneira como as empresas (e seus RHs) atuam e cuidam de seus integrantes.