Refactor and maintain web scrapers to improve reliability and efficiency.
Implement advanced scraping techniques to avoid detection and blocking.
Collaborate with cross-functional teams to gather requirements and ensure data quality.
YipitData is a market research and analytics firm for the disruptive economy, analyzing billions of alternative data points daily. They provide insights on ridesharing, e-commerce marketplaces, payments, and more to investment funds and corporations and have been recognized as one of Inc’s Best Workplaces.
Lead the architecture and evolution of scalable, distributed data pipelines, ensuring high availability and performance at scale
Build and maintain distributed web scraping systems using tools such as Playwright, Selenium, and BeautifulSoup
Integrate AI and LLMs into engineering workflows for code generation, automation, and optimization
MercatorAI is building scalable data infrastructure to power high-quality, data-driven decision making at scale. As an early-stage company, the team is focused on creating robust, future-ready systems that can handle complex data ingestion, transformation, and delivery across a growing national footprint.
Elevate and extend existing collection capabilities.
Design cross-layer systems that remain reliable.
Translate real-world data needs into durable technical systems.
Vannevar is a defense technology company building AI to deter our adversaries. They are a small agile team combining world-class engineers with veteran strategists who bring deep expertise in defense and tradecraft.