Job Description
The ideal candidate will be proficient in Python and experienced in developing and maintaining robust web scraping solutions. The role will focus on utilizing a configuration-based approach to extract data from a diverse range of websites. The solutions developed will be hosted on Amazon Web Services (AWS), with data stored in Amazon S3 buckets.
Key Responsibilities include developing, deploying, and maintaining scalable Python web scraping scripts using a configuration-driven approach, using AWS services, designing data pipelines, and maintaining documentation. Required Skills include expertise in web scraping, strong knowledge of HTML, CSS, JavaScript, DOM, APIs, JSON, XML, and proficiency with Git.