Contribute to architecture and improvement of our data acquisition and processing platform.
Use and develop web crawling technologies to capture and catalog data on the internet.
Design and develop backend services for distributed job orchestration, data pipelines, and large-scale asynchronous workloads.
People Data Labs is a provider of people and company data, integrating thousands of compliantly sourced datasets into a single, developer-friendly source of truth. We are a team focused on extreme ownership and a one-team mindset, embracing failure as a learning opportunity.
Design and scale web scraping infrastructure for collecting millions of social media records daily.
Build fault-tolerant pipelines using Python/Go, browser automation, and anti-bot bypass techniques.
Manage distributed queues, storage lakes, and monitoring for reliable data delivery at scale.
The hiring partner company builds high-performance web scraping and data ingestion infrastructure for social media and AI workflows. It values reliability, performance, and continuous improvement, though its size and culture are not detailed.
Find, evaluate, and collect valuable training data from web, code, and technical sources.
Build scalable pipelines that turn raw data into training-ready corpora through extraction, cleaning, deduplication, and filtering.
Work with researchers on data mixtures and sampling strategies for pretraining and midtraining.
Prime Intellect builds the open superintelligence stack, offering a full-stack platform for post-training frontier AI models. Backed by $150M in funding, it is a mission-driven team focused on accelerating science and AI.