Similar Jobs
See allData Engineer
Wynd Labs
Global
Python
Web Scraping
Data Warehousing
Experienced Web Scraping Engineer - Python
Oxylabs
Global
Python
Git
Web Scraping
Senior Data Engineer
Jobgether
Python
SQL
AWS
Chief Technology and Product Officer
ScraperAPI
Europe
Web Scraping
AI/ML
Product Strategy
Engineering Intern
GovSignals
US
TypeScript
Python
Web Scraping
Role Overview:
- You will own the next generation of reliable web-data acquisition within a modern data platform.
- You will design, build, and operate production-grade Python scrapers and scalable ingestion pipelines.
- This role focuses on improving the maturity, reliability, and scalability of web-scraping capabilities.
Key Responsibilities:
- You will own the development, deployment, and operation of web-scraping pipelines.
- You will establish reusable patterns for extraction, scheduling, storage, monitoring, validation, and failure handling.
- You will investigate new data sources and determine the best acquisition method.
What We Offer:
- Fully remote position in a remote-first technology team.
- Opportunity to take ownership and influence the architecture and operating standards.
- Collaboration with a distributed engineering team through code reviews and structured workflows.
Partner Company
The company specializes in data engineering and web-data acquisition for research and data products. It embraces a remote-first culture with a distributed, collaborative engineering team.