Source Job

$160,000–$200,000/yr
Global Unlimited PTO

  • Contribute to architecture and improvement of our data acquisition and processing platform.
  • Use and develop web crawling technologies to capture and catalog data on the internet.
  • Design and develop backend services for distributed job orchestration, data pipelines, and large-scale asynchronous workloads.

Python Go Rust Distributed Systems

20 jobs similar to Senior Data Engineer

Jobs ranked by similarity.

Ireland

  • Design and scale web scraping infrastructure for collecting millions of social media records daily.
  • Build fault-tolerant pipelines using Python/Go, browser automation, and anti-bot bypass techniques.
  • Manage distributed queues, storage lakes, and monitoring for reliable data delivery at scale.

The hiring partner company builds high-performance web scraping and data ingestion infrastructure for social media and AI workflows. It values reliability, performance, and continuous improvement, though its size and culture are not detailed.

Global

  • Find, evaluate, and collect valuable training data from web, code, and technical sources.
  • Build scalable pipelines that turn raw data into training-ready corpora through extraction, cleaning, deduplication, and filtering.
  • Work with researchers on data mixtures and sampling strategies for pretraining and midtraining.

Prime Intellect builds the open superintelligence stack, offering a full-stack platform for post-training frontier AI models. Backed by $150M in funding, it is a mission-driven team focused on accelerating science and AI.

Global

  • Own and operate the data platform end to end, including scrapers, pipelines, backend services, and infrastructure.
  • Build monitoring, alerting, and data quality checks to keep systems reliable and catch issues before they matter.
  • Simplify a fast-growing data setup into one documented system while guiding junior engineers and explaining trade-offs to the team.

Melotech creates art through technology for media and entertainment, reaching millions of minutes of engagement worldwide. Backed by top VCs and founded by an entrepreneur-investor, the company offers a remote-first culture with global offsites and equity ownership.

US

  • Design, develop, and maintain large-scale distributed database and storage systems.
  • Build performance-critical infrastructure using Go, Rust, C++, or similar systems programming languages.
  • Operate production systems and troubleshoot complex reliability, performance, and availability issues.

This company builds and operates large-scale distributed database and storage infrastructure with a focus on low latency and high availability. They offer a fully remote, multinational work environment and comprehensive healthcare coverage.

Global 5w PTO 16w maternity 6w paternity

  • Design and build distributed systems for ingestion, normalization, processing, storage, and delivery of realtime market data.
  • Build and operate streaming solutions handling event ordering, timestamps, duplicates, replay, gaps, and recovery.
  • Lead technical decisions, write clear designs, and mentor engineers to deliver reliable data platforms.

Dune is a blockchain data and intelligence provider making onchain finance observable, serving 130+ chains and 1,000+ industry leaders. We're a tight-knit team of ~50 hardworking people across Europe and US timezones, humble yet ambitious.

US Unlimited PTO

  • Lead the architecture and development of the Hercules Database, backend services, and SDKs.
  • Engineer for low latency, high throughput, and efficient resource use across data-intensive, multi-tenant systems.
  • Build and operate reliable hosting infrastructure with strong tenant isolation, observability, and failure resilience.

Hercules builds the future of AI software development with a platform-as-a-service including a database, backend services, and SDKs. It is an early-stage company with a founding team based in San Francisco and a culture that values shipping fast, excellence, and hunger.

Europe South Africa 5w PTO

  • Design and implement core backend services for high-performance, distributed payment systems.
  • Take ownership of architectural decisions, balancing scalability, reliability, and maintainability.
  • Collaborate with cross-functional teams to improve developer experience through testing, code reviews, and documentation.

The company builds payment infrastructure that lets businesses manage payments efficiently across international markets. It is a globally distributed, product-driven engineering team that values collaboration, engineering excellence, and long-term growth.

Global

  • Scrape various APIs on an industrial scale, handling terabytes of data daily.
  • Build backend services using Python, focusing on high-load, data-intensive systems and optimizing data pipelines.
  • Write and review code for quality, security, and best practices, implementing automated testing and CI/CD processes.

SplitMetrics is a global software company that provides a growth engine for top mobile-first businesses through an ecosystem of products and services, including platforms for Apple Ads and A/B testing. With over 11 years in the mobile marketing industry and a team across 20+ countries, they have a remote-first culture and have integrated AI since 2023.

$193,461–$291,000/yr
US

  • Work on core infrastructure powering Arbitrum, tackling distributed systems challenges and optimizing performance.
  • Collaborate with research, product, and blockchain engineering teams at the cutting edge of blockchain technology.
  • Establish backend architectural standards and drive technical roadmap for complex distributed systems.

Offchain Labs is a pioneer in blockchain scalability and security, building the Arbitrum stack that powers the leading Ethereum scaling solution. Backed by $124 million in funding, our team of thinkers and doers embraces new challenges and pushes boundaries.

US Unlimited PTO

  • Design, build, and maintain robust backend services and APIs at scale.
  • Collaborate with stakeholders to architect and deliver new services from inception to completion.
  • Work with engineering and product teams to shape roadmaps and uphold high engineering standards.

Sardine is the leading agentic risk platform for fighting financial crime, providing real-time fraud prevention and AML automation. The company is remote-first and values performance over hours, with a culture of self-motivated, high-growth individuals.

US

  • Develop core backend infrastructure for blockchain execution and Ethereum scaling.
  • Tackle distributed systems challenges involving reliability, performance, and scalability.
  • Strengthen security and drive projects from investigation through implementation.

They build foundational infrastructure for Ethereum scalability, security, and decentralized applications. They are a remote-first, globally distributed team collaborating across research, product, and blockchain engineering.

Spain Unlimited PTO

  • Design and develop high-performance backend systems in Rust that collect billions of data points from the web.
  • Work on our in-house proxy layer, browser tooling, and protocol-level behavior to handle close to 200 million requests a day.
  • Collaborate with crawler engineers, DevOps, and Security to build secure, scalable, and reliable crawling infrastructure.

Lighthouse is on a mission to revolutionize commercial strategy as hospitality's most powerful AI platform, transforming the world's largest hotel data network into real-time intelligence. With 850+ teammates across 35 countries and $370M in Series C funding, we foster a collaborative, customer-centric culture focused on innovation and growth.

Global

  • Build scalable, high-load systems in Python and work with big data processing 200–400M+ records per day.
  • Design and develop integrations with external channels behind a unified data model and API.
  • Ensure data quality and consistency across channels through validation, reconciliation, and monitoring.

SplitMetrics is a global software company providing a growth engine for mobile-first businesses through its ecosystem of products and services, including Apple Ads optimization and A/B testing. With over 11 years of experience and a remote-first culture, the company collaborates across 20+ countries and values transparency, speed, and continuous learning.

India

  • Own architecture health of large-scale distributed systems, including failure modes, capacity constraints, and consistency guarantees.
  • Identify and remediate systemic risks such as single points of failure, unbounded queues, and data-loss scenarios.
  • Work hands-on with Node.js/Go and GCP technologies to prototype solutions and resolve complex failures.

This company operates large-scale distributed systems processing billions of events and messages. Its engineering culture values technical rigor, proactive problem solving, and clear cross-team communication.

Global Unlimited PTO

  • Enhance and scale a high-performance data onboarding platform to handle real-time data at petabyte scale.
  • Own and evolve infrastructure across multiple cloud providers, including AWS, GCP, and Azure.
  • Drive architectural decisions, improve deployment pipelines, and participate in on-call rotations.

ClickHouse is the company behind the open-source ClickHouse database, providing a high-performance database platform. It is a globally distributed start-up operating in over 25 countries, with a culture that values autonomy, innovation, and impact.

$220,000–$320,000/yr
US

  • Own and improve the platform that processes customer jobs, focusing on speed, reliability, and resource efficiency.
  • Partner with machine learning teams to serve models effectively and integrate them into production workflows.
  • Build and maintain infrastructure for databases, task orchestration, workload scheduling, and cloud deployments.

They build an AI document processing product and operate its platform infrastructure. Company size and culture are not specified, but engineers work closely with ML teams and own platform reliability.

$185,000–$305,000/yr
Americas Europe Africa Unlimited PTO

  • Own Elicit's scholarly search and data platform, covering coverage, freshness, quality, and cost.
  • Build secure, rights-aware integrations for enterprise customers and content partners.
  • Ship features end-to-end across frontend, backend, and data with staged rollouts.

Elicit is an AI research agent that helps scientists and decision-makers find, synthesize, and understand research. We are a public benefit corporation with a small, AI-native engineering team focused on high-stakes evidence.

North America

  • Take deep ownership of key systems and product areas, becoming the technical expert and primary point of reference.
  • Architect, build, and maintain highly available and scalable REST APIs and backend services.
  • Use agentic development workflows and AI coding tools as standard engineering practice.

This partner company builds an AI-driven e-commerce messaging platform powered by customer context and data. It is a high-growth, remote-first environment with a collaborative and supportive culture.

India 5w PTO 26w maternity 2w paternity

  • Lead architecture and delivery of distributed cloud-native applications for high concurrency and real-time data needs.
  • Build scalable data pipelines, streaming analytics, and integrate ML/AI workflows with data science and engineering partners.
  • Set engineering standards for code quality, security, reliability, and mentor peers while decomposing legacy systems into microservices.

Outreach is the only complete agentic AI platform for revenue teams, powering hundreds of use cases across revenue motions with AI-driven automation and conversation intelligence. The company serves world-leading enterprises like Databricks, SAP, Siemens, and Verizon, fostering an inclusive culture with employee resource groups and a focus on innovation.

$145,500–$235,400/yr
US

  • Design, implement, test, and operate production services and APIs.
  • Lead projects or meaningful components of projects from problem definition through deployment and iteration.
  • Improve the observability and operability of the systems you own, including metrics, logs, traces, alerting, and incident learnings.

LaunchDarkly provides a platform that helps engineering teams release software and AI with speed, safety, and control using feature flags and observability. The company is growing and emphasizes teamwork, humility, openness, curiosity, and inclusive collaboration.