Senior Data Infrastructure Engineer (Scraping & Scale)

Jobgether

Remote regions

Ireland

Benefits

Similar Jobs

See all

Senior Anti-Bot Engineer

Adthena

UK

Python Web Scraping HTTP

Senior Data Engineer (Web Scraping)

Partner Company

India

Python Web Scraping Data Engineering

Backend Engineer – Data Acquisition

Lighthouse

Spain

Rust Python Google Cloud

Senior Data Engineer

Jobgether

Python SQL AWS

Engineering Intern

GovSignals

US

TypeScript Python Web Scraping

About the Role:

  • Design and scale high-performance web scraping and data ingestion systems.
  • Work at the intersection of data engineering, automation, and AI infrastructure.

Key Responsibilities:

  • Lead development of scalable data collection systems and reliable ingestion.
  • Build fault-tolerant scraping pipelines for Instagram, TikTok, YouTube, and X.
  • Architect storage with Parquet, Iceberg, Snowflake, and S3.

Requirements:

  • 4+ years in web scraping, data engineering, or reverse engineering.
  • Expertise in anti-bot systems like Cloudflare and Akamai.
  • Advanced proficiency in Python or Go and distributed task queues.

Jobgether

The hiring partner company builds high-performance web scraping and data ingestion infrastructure for social media and AI workflows. It values reliability, performance, and continuous improvement, though its size and culture are not detailed.

Apply for This Position