Source Job

Unlimited PTO

  • Identify and explore public and compliant channels for 3D model assets.
  • Design and develop high-performance web crawlers to automate the end-to-end pipeline.
  • Maintain and optimize distributed crawler systems; monitor node health to ensure system stability.

MySQL PostgreSQL MongoDB Redis

20 jobs similar to 3D Data Crawler Engineer

Jobs ranked by similarity.

Asia Unlimited PTO

  • Independently formulate data quality assurance (QA) standards based on delivery requirements.
  • Conduct rigorous quality checks and acceptance testing on delivered data.
  • Manage project team members and provide them with professional technical support, guidance, and mentorship.

Meshy is a leading 3D generative AI company with a mission to unleash 3D creativity by transforming the content creation pipeline. They have a multi-regional culture with talent distributed across North America, Asia, and Oceania and have raised $52 Million in funding.

Asia Unlimited PTO

  • Collaborate with algorithm engineers to define 3D art specifications and benchmark standards suitable for AI training.
  • Establish and optimize the artistic pipeline for 3D data cleaning and Quality Assurance (QA).
  • Monitor the quality of models delivered by outsourcing vendors or suppliers and provide actionable feedback for improvement.

Meshy is a leading 3D generative AI company based in Silicon Valley, with a mission to transform content creation. They have a global team distributed across North America, Asia, and Oceania, and they are backed by premiere venture capital firms like Sequoia and GGV.

US

  • Build and own pipelines for the creation, curation, and processing of large-scale multimodal datasets.
  • Build and own ETL and CDC streams from Postgres and ClickHouse to analytics warehouses.
  • Manage production databases (Postgres, ClickHouse) and optimize for performance and reliability

Runway is building AI to simulate the world through merging art and science. They believe that world models are at the frontier of progress in artificial intelligence. The Runway team consists of creative, open minded, caring and ambitious people who are determined to change the world.

  • Design and build robust, scalable services that power Al-driven systems.
  • Implement clean, modular, and testable code across distributed systems.
  • Own data modeling, schema design, and performance optimization.

Artificial.Agency is building AI-driven systems. They seem to have a flexible work environment and value diverse perspectives, creating an inclusive environment for employees.

$535–$1,605/mo
Philippines

  • Build amazing things using MongoDb, Next.js, Nest.js, Node.js, PHP, and MySQL.
  • Code (writing, reviewing, deploying, testing, reviewing).
  • Impact the software in many unique ways.

Career TEAM is a socially conscious organization that seeks to close the nation’s opportunity divide through government-funded workforce development programs. They develop and leverage cutting-edge software tools to ignite transformative change within the workforce development industry, employing around 500 people.

Global

  • Design, build, and operate scheduled and event-driven data pipelines for simulation outputs, telemetry, logs, dashboards, and scenario metadata
  • Build and operate data storage systems (structured and semi-structured) optimized for scale, versioning, and replay
  • Support analytics, reporting, and ML workflows by exposing clean, well-documented datasets and APIs

Onebrief is collaboration and AI-powered workflow software designed specifically for military staffs. They transform this work, making the staff faster, smarter, and more efficient. The company is all-remote with employees working alongside customers; it was founded in 2019 and has raised $320m+.

Brazil

  • Manage the flow of data from ingestion to final consumption.
  • Develop and maintain entity-relationship models.
  • Design and implement data pipelines using preferrable SQL or Python.

Teachable is a platform for experts and businesses who take education seriously. They help experts and businesses scale their impact and operations through courses, coaching, and digital downloads that students actually love. Teachable is part of the global Hotmart Company portfolio.

North America Asia Unlimited PTO

  • Design, implement, and maintain distributed ingestion pipelines for structured and unstructured data.
  • Build scalable ETL/ELT workflows to transform, validate, and enrich datasets for AI/ML model training and analytics.
  • Support preprocessing of unstructured assets for training pipelines, including format conversion, normalization, augmentation, and metadata extraction.

Meshy is a leading 3D generative AI company transforming content creation by enabling the creation of 3D models from text and images. They have a global team distributed across North America, Asia, and Oceania and are backed by venture capital firms like Sequoia and GGV, with $52 Million in funding.

US

  • Design and maintain ETL pipelines that ingest, process, and load data into AWS Neptune.
  • Develop and evolve graph data models representing relationships across users, sessions, devices, and security events.
  • Integrate diverse data sources including S3, relational databases, streaming services, and APIs into a cohesive graph architecture

Keeper Security is transforming cybersecurity for organizations around the world with next-generation privileged access management. Keeper’s zero-trust and zero-knowledge cybersecurity solutions are FedRAMP and StateRAMP Authorized, FIPS 140-2 validated, as well as SOC 2 and ISO 27001 certified.

UK 5w PTO

  • Code, test, and document new or modified data pipelines.
  • Conduct logical and physical database design.
  • Perform root cause analysis on internal and external data.

Aker Systems builds and operates ground-breaking, ultra-secure, high performance, cloud-based data infrastructure for the enterprise. They were recognised as a ‘One to Watch’ on the Sunday Times Tech Track and won the Thames Valley Tech Company of the year.

Canada

  • Design, build, and maintain innovative tools to meet evolving business needs.
  • Leverage open source automation tools and scripting languages to streamline processes.
  • Contribute to solving complex technical problems and automating responses.

Jobgether uses an AI-powered matching process. They ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements.

$171,000–$220,000/yr
US Unlimited PTO

  • Design, implement, and maintain robust, automated data pipelines.
  • Model and optimize data in Snowflake to support analytics.
  • Ensure data reliability through automated quality checks, monitoring, observability, and lineage visibility.

Acquisition.com focuses on acquiring and growing businesses. We foster a lean, high-ownership environment.

$135,000–$220,000/yr
US Unlimited PTO

  • Design, develop, and maintain reliable end-to-end data pipelines that connect internal and external systems.
  • Contribute to the performance, scalability, and reliability of our entire data ecosystem.
  • Work with analysts to engineer data structures and orchestrate workflows that encode core business logic.

Roo is on a mission to empower animal healthcare professionals with opportunities to earn more and achieve greater flexibility in their careers and personal lives. Powered by groundbreaking technology, Roo has built the industry-leading veterinary staffing platform, connecting Veterinarians, Technicians, and Assistants with animal hospitals for relief work and hiring opportunities.

Nigeria

  • Design and implement data pipelines and workflows.
  • Develop and maintain data models for optimal data storage.
  • Collaborate with cross-functional teams to gather data requirements.

Jobgether is a platform that connects job seekers with companies using AI-powered matching. They aim to ensure applications are reviewed quickly and fairly.

$130,000–$130,000/yr
Americas Unlimited PTO

  • Build and evolve our semantic layer, design, document, and optimize dbt models.
  • Develop and maintain ETL/orchestration pipelines to ensure reliable and scalable data flow.
  • Partner with data analysts, scientists, and stakeholders to enable high-quality data access and experimentation.

Customer.io's platform is used by over 7,500 companies to send billions of emails, push notifications, in-app messages, and SMS every day. They power automated communication and help teams send smarter, more relevant messages using real-time behavioral data; their culture values empathy, transparency, and responsibility.

Europe

  • Reverse engineer and build integrations with external APIs and services
  • Use best programming practices to optimize code performance
  • Write and maintain unit and integration tests

Truv is transforming the financial data industry with a secure and real-time API platform for payroll account access. Backed by $30M from top investors, they’re disrupting a $2B legacy market with cutting-edge innovation and a customer-first approach.

$110,572–$145,000/yr
US Unlimited PTO

  • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and design data models and schemas that facilitate data analysis and reporting
  • Design, develop, and maintain scalable and efficient data pipelines and ETL processes to ingest, process, and transform large volumes of data from various sources into usable formats
  • Build and optimize data storage and processing systems, including data warehouses, data lakes, and big data platforms, using AWS services such as Amazon Redshift, AWS Glue, AWS EMR, AWS S3, and AWS Lambda, to enable efficient data retrieval and analysis

ATPCO is the world's primary source for air fare content. They hold over 200 million fares across 160 countries and the travel industry relies on their technology and data solutions. ATPCO believes in flexibility, trust, and a culture where your wellbeing comes first.

Brazil Canada US Latin America

  • Work alongside Caylent’s Architects, Engineering Managers, and Engineers to deliver AWS solutions.
  • Build solutions defined in project backlogs, writing production-ready, well-tested, and documented code across cloud environments.
  • Participate in Agile ceremonies such as daily standups, sprint planning, retrospectives, and demos.

Caylent is a cloud native services company that helps organizations bring the best out of their people and technology using Amazon Web Services (AWS). They are a global company and operate fully remote with employees in Canada, the United States, and Latin America fostering a community of technological curiosity.

$135,000–$200,000/yr
US Unlimited PTO

  • Design, develop, and maintain scalable, and efficient backend systems and services that meet enterprise requirements
  • Optimize and improve the performance, reliability, and scalability of existing backend systems
  • Write clean, maintainable, and testable code that adheres to best practices

Cortex is the AI-powered Internal Developer Portal that helps engineering leaders at companies build organizations that ship reliable, secure, and efficient software, faster. They are a mighty group of ~100 passionate individuals excited about building a product that developers love.

$85,000–$95,000/yr
US

  • Design and develop data integration pipelines across cloud and legacy systems.
  • Lead and support data engineering implementation efforts.
  • Apply advanced analytics techniques to support business insights and decision-making.

Jobgether uses an AI-powered matching process to ensure applications are reviewed quickly and fairly. They identify the top-fitting candidates and share this shortlist directly with the hiring company, with the final decision managed by the internal team.