Source Job

$73,000–$90,000/yr
United States Unlimited PTO

  • Lead, mentor, and grow a team of web scraping engineers.
  • Own the architecture, scalability, and reliability of scraping systems.
  • Collaborate with Engineering, Data, and Product teams to deliver high-quality data.

Playwright Selenium

4 jobs similar to Web Scraping Lead

Jobs ranked by similarity.

India

  • Design, build, and maintain robust web scrapers to power critical reports and customer experiences.
  • Implement advanced scraping techniques including fingerprinting, cookie management, and proxy rotation to avoid detection.
  • Collaborate with cross-functional teams and monitor scraper performance to ensure high-quality data delivery.

YipitData is a leading market research and analytics firm for the disruptive economy, analyzing billions of alternative data points daily. Backed by The Carlyle Group and Norwest Venture Partners, the company is recognized as one of Inc's Best Workplaces and cultivates a people-centric culture focused on mastery, ownership, and transparency.

  • Build and design large-scale distributed crawling bots and infrastructure to extract data from diverse sources including web pages, APIs, and PDFs.
  • Develop and maintain data pipelines using Python, Scrapy, Airflow, and Spark to ingest, clean, and normalize data for search indexing and downstream ML/NLP.
  • Collaborate with ML/NLP teams to integrate classification models and utilize LLMs for precise answers from OEM repair procedures.

Tekmetric provides all-in-one cloud-based software for auto repair shops, helping them run smarter and grow faster. Founded in 2017 and headquartered in Houston, the company has grown from a single shop's vision to an industry-leading solution, fostering a culture of transparency, integrity, innovation, and service-first mindset.

US Unlimited PTO

  • Lead and grow a team of engineers specializing in web application discovery and attack surface enumeration.
  • Set technical direction, methodology standards, and quality expectations for the team's deliverables.
  • Partner with Product and software engineering teams to translate discovery gaps into prioritized roadmap input.

Horizon3 is a fast-growing, remote cybersecurity company dedicated to autonomous pentesting through its NodeZero platform. They are a team of former Special Operations cyber operators, engineers, and security practitioners committed to a culture of collaboration and ownership.

Global

  • You ship scrapers and ingestion flows against messy, sometimes adversarial sources using HTTP/2 clients, TLS-fingerprint evasion, and browser automation fallbacks.
  • You own Postgres schema design and migrations end to end across per-country and per-domain schemas.
  • You build and maintain medallion transforms that are idempotent, content-hashed, and lineage-tracked.

Labrynth builds AI-powered platforms that navigate complex regulations and generate audit-level documentation. They operate as a small, high-velocity team embedded directly with clients to rapidly ship production-quality solutions.