Job Description
The Data Engineer will develop and maintain scalable data pipelines and ETL processes. They will build and optimize data models and workflows for analytics and reporting and leverage Python (Pandas, NumPy) for data transformation and analysis. They will work with SQL, Databricks, and Spark to process large-scale datasets and ensure data quality and integrity across systems and pipelines. This role will collaborate with cross-functional teams to define data requirements and deliver solutions, participate in code reviews and contribute in Agile development environments, and translate complex datasets into actionable insights for business stakeholders.
The ideal candidate has 3+ years of experience with Python, SQL, and Databricks, a strong command of data frameworks/tools (e.g., Pandas, Jupyter), and hands-on experience with big data technologies (e.g., Spark, Databricks) working in Agile methodologies with excellent problem-solving and analytical skills. A Bachelor’s degree in Computer Science, Information Technology, or equivalent experience is also required, and healthcare industry experience or familiarity with healthcare data is a plus.