Data Engineer

Who We Are:

• We build infrastructure that delivers massive amounts of web data to the companies training the world’s most powerful AI models.
• We're lean, technical, and move fast with no red tape or slow decision-making.

Who You Are:

• You have a Bachelor’s degree or equivalent work experience and advanced Python skills with strong grasp of async programming and multiprocessing.
• You have hands-on experience with high-volume web scraping, distributed data pipelines, and data warehousing with columnar/analytical warehouses.

What You'll Be Doing:

• Maintain, optimize, and troubleshoot database queries and related data systems.
• Assist in creating, maintaining, and improving data pipelines for large-scale datasets.
• Support web scraping and data collection initiatives to gather publicly available data.

Why Work With Us:

• Opportunity to be at the forefront of developing a web-scale crawler and knowledge graph improving access to public web data.
• Culture of low ego and high output on a fully remote team with competitive salary, benefits, and equity package.