Source Job

$199,750–$260,000/yr
US

  • Design, implement, and operate high-throughput data ingestion pipelines that transform raw pentest output into structured, queryable data at scale.
  • Own end-to-end delivery of pipeline features including schema design, implementation, testing, deployment, and monitoring in containerized environments like Kubernetes and AWS.
  • Partner with downstream teams to define data contracts and resolve production issues in pipeline latency, data correctness, and throughput.

Go Python ETL Kafka PostgreSQL

20 jobs similar to Sr. Software Engineer - Data Ingestion

Jobs ranked by similarity.

$217,000–$303,900/yr
US

  • Lead the development of Reddit's Ingestion Platform, designing and delivering reliable software for distributed data movement across streaming and batch workloads.
  • Own the architecture of the platform's control and data planes, including pipeline APIs, connectors, and sink integrations, expanding beyond Kafka-to-BigQuery to S3/GCS and Apache Iceberg.
  • Mentor engineers, drive migrations from legacy systems, and establish robust reliability, security, and operational practices for pipelines running on Kubernetes.

Reddit is a community of communities built on shared interests, passion, and trust, hosting authentic conversations across 100,000+ active communities and approximately 130 million daily active unique visitors. The company fosters an open, collaborative culture with a focus on reliability, performance, and efficiency.

Global Unlimited PTO

  • Enhance and scale a high-performance data onboarding platform to handle real-time data at petabyte scale.
  • Own and evolve infrastructure across multiple cloud providers, including AWS, GCP, and Azure.
  • Drive architectural decisions, improve deployment pipelines, and participate in on-call rotations.

ClickHouse is the company behind the open-source ClickHouse database, providing a high-performance database platform. It is a globally distributed start-up operating in over 25 countries, with a culture that values autonomy, innovation, and impact.

$157,000–$184,000/yr
US Canada UK Unlimited PTO 18w maternity 12w paternity

  • Build and maintain core components of the clearing house in Go on GCP, including customer onboarding flows and data ingestion pipelines.
  • Take ownership of ambiguous problems and specific features, driving them from design through production with appropriate testing and observability.
  • Design, implement, and operate reliable agentic workflows that automate complex, multi-step tasks across production systems.

Chainguard is the trusted source for open source, delivering hardened, secure, and production-ready builds of open source software. The company is venture-backed by leading investors and serves Fortune 500 enterprises, including OpenAI and Snowflake.

North America Unlimited PTO

  • Take deep ownership of systems and product areas, becoming the go-to technical expert for what you own.
  • Architect, build, and maintain highly available, scalable REST APIs and backend services across distributed systems.
  • Build agentically with AI coding tools, staying at the forefront of emerging AI tooling and practices.

Postscript is an AI messaging platform for Shopify brands, helping e-commerce marketers drive revenue through SMS marketing and AI features. Backed by Greylock and Y Combinator, the company has been fully remote since 2018 and serves 20,000+ Shopify brands with a culture of ownership and AI-first development.

$164,200–$229,900/yr
US

  • Refine and maintain data infrastructure for ML and analytics workflows on data from hundreds of millions of users.
  • Own the Data Movement Platform enabling batch and stream processing, investing in Spark, Flink, and Airflow technologies.
  • Build automated solutions to minimize toilsome work, providing a declarative, self-service experience for data users.

Reddit is a community of communities built on shared interests, passion, and trust, home to the most open and authentic conversations on the internet. With over 100,000 active communities and approximately 130 million daily active unique visitors, Reddit is one of the internet's largest sources of information, fostering a flexible and inclusive culture.

$195,000–$280,000/yr
US 4w PTO 12w maternity 12w paternity

  • Design, develop, and maintain scalable back end services and APIs for Quanata's products.
  • Architect data flows, database schemas, and cloud infrastructure with a focus on reliability and security.
  • Mentor engineers and shape technical decisions across complex features from concept to deployment.

Quanata is a technology company in the State Farm family, building products and services for the financial and insurance sectors. It is a remote-first organization that values veterans, supports professional growth, and offers comprehensive benefits.

US Unlimited PTO

  • Own and scale the end-to-end ingestion to catalog to derived pipeline powering InfraSpec datasets across all core domains.
  • Lead the migration from legacy scripts to a durable platform, including architecting the greenfield graph layer for RouteFinder.
  • Enforce data contracts, quality gates, and observability to keep pipeline rework under 20%.

Inflect is building a marketplace that transforms how companies buy and sell digital infrastructure—datacenter, cloud, and network services. As a fast-growing startup, we work quickly and collaboratively; full-time employees receive option grants and share ownership.

$170,000–$235,000/yr
US

  • Design and implement backend services for licensing, entitlements, feature access, and usage limits across NodeZero's product and APIs.
  • Build and evolve provisioning, admin experience, MSP/MSSP capabilities, and audit logging for a multi-tenant SaaS platform.
  • Operate production services with monitoring, incident response, and a high bar for design quality and test coverage.

Horizon3 is a fast-growing, remote cybersecurity company that helps organizations proactively find, fix, and verify exploitable attack vectors through its NodeZero autonomous pentesting platform. The team is a fusion of former special operations cyber operators and startup engineers, fostering a culture of respect, collaboration, ownership, and results.

$130,000–$150,000/yr
US Unlimited PTO

  • Own customer data integrations for hospital systems from discovery to production
  • Design and build reliable data pipelines ingesting ERP and operational data
  • Troubleshoot integration failures and build reusable connectors for scale

Clarium is an AI-powered healthcare supply chain platform reducing hospital overspending through its Astra OS. Founded in 2020, it has raised $43M and is trusted by top health systems, with a high-growth, collaborative culture.

US Unlimited PTO

  • Configure and support data ingestion from various sources using APIs, webhooks, syslog, and more.
  • Develop and maintain pipelines for collection, routing, filtering, enrichment, and transformation.
  • Validate data completeness and troubleshoot issues, while documenting flows and recommendations.

GuidePoint Security provides trusted cybersecurity expertise, solutions and services that help organizations minimize risk. It is a rapidly growing, privately-held company with over 1,300 employees, known for its collaborative culture and mentorship.

India

  • Design, build and maintain reliable data pipelines in Python on AWS.
  • Build and maintain backend services and APIs using Django and FastAPI.
  • Take end-to-end ownership of assigned work, including design, testing, code reviews, releases and production support.

Smart Working connects skilled professionals with global teams for full-time remote roles, aiming to break down geographic barriers. It fosters a remote-first community focused on growth and well-being, and is rated highly on Glassdoor.

$150,000–$170,000/yr
US

  • Design and scale backend systems for data infrastructure, including PostgreSQL data models, Kafka event pipelines, and a GraphQL API.
  • Lead the integration of new services and own the pipelines that deliver dataset snapshots into our warehouse.
  • Collaborate with platform and application teams to implement APIs that unlock new workflows for clinical studies and digital health products.

Beacon Biosignals is transforming precision medicine for the brain with at-home EEG and diagnostic platforms for neurological, psychiatric, and sleep disorders. The company values diversity, empathy, and a self-service mindset, with a collaborative remote-first culture.

$2,000–$2,500/mo
Latin America

  • Own data workflows end to end, including ingestion, storage, orchestration, transformation, validation, and delivery.
  • Develop and maintain ETL and ELT pipelines using workflow orchestration and event-driven processing.
  • Partner with cross-functional teams to clarify requirements, investigate discrepancies, and communicate technical constraints.

GoFasti is a Talent-as-a-Service company that bridges world-class developers and designers from Latin America with first-class companies globally. We are a growing team focused on making remote work remarkable, connecting top talent to opportunities.

$125,000–$150,000/yr
US Unlimited PTO

  • Design, develop, and maintain back-end components for internal and open-source cybersecurity projects.
  • Build REST and GraphQL APIs, command-line tools, and containerized services using Python, Go, and Docker.
  • Contribute to infrastructure automation and collaborate with teammates to solve complex technical problems.

SpecterOps develops internal and open-source cybersecurity projects such as Mythic and Ghostwriter for the security community. We are a small, transparent team that values autonomy, collaboration, and continuous improvement.

UK 5w PTO

  • Design robust Python data ingestion processes from diverse sources using AWS tools like Athena, Glue, Lambda, and Redshift.
  • Provision AWS infrastructure with Infrastructure-as-Code and embed observability to ensure high data reliability.
  • Partner with analysts and business teams to deliver seamless data and champion data quality and testing standards.

Reach is Britain and Ireland's largest commercial news publisher, home to over 120 brands including the Mirror and Daily Star. We reach 70% of the UK's online population and foster an inclusive, growth-oriented culture.

$170,000–$210,000/yr
US Unlimited PTO

  • Own AWS data architecture and technical roadmap across ingestion, transformation, storage, and serving.
  • Build reliable batch and near-real-time pipelines with clear SLAs and observability.
  • Model ERP supply chain data into a reusable warehouse and lead legacy migration.

Clarium is an AI-powered healthcare supply chain platform that helps hospitals reduce overspending and improve efficiency with its Astra OS. Founded in 2020, Clarium has raised $43M and is trusted by leading health systems, with a collaborative, fast-paced culture.

$146,000–$225,000/yr
US Unlimited PTO

  • Break down larger projects into individual tasks and deliver them in phases with support from your tech lead and manager.
  • Collaborate with product management, design, and analytics to make decisions that consider risks and trade-offs.
  • Support operations and availability of your team's artifacts by creating metrics and participating in on-call efforts.

Affirm is a financial technology company that provides transparent, flexible payment solutions. The company is remote-first and fosters a culture of care, transparency, and flexibility.

US

  • Design and build production software and data systems for a premier banking client.
  • Work hands-on with cloud-native technologies and modern architecture on enterprise-scale data movement and transformation.
  • Collaborate in Agile teams applying strong Python, AWS, and relational database skills to real-time and batch processing.

Kunai builds full-stack technology solutions for banks, credit and payment networks, infrastructure providers, and their customers. Our exceptional team thrives in a culture of collaboration, creativity, and continuous learning, with a track record of success spanning over 20 years.

$148,750–$190,000/yr
US

  • Implement and maintain API endpoints, middleware, and platform services in Go.
  • Build and evolve the API gateway layer, including routing, authentication, rate limiting, and request/response shaping.
  • Write and maintain API contracts (OpenAPI/gRPC) and contribute to service reliability with monitoring and incident response.

Horizon3 is a fast-growing remote cybersecurity company that provides autonomous penetration testing through its NodeZero platform. The company fosters a culture of respect, collaboration, ownership, and results, with a team of former U.S. Special Operations cyber operators and startup engineers.

United States

  • Design and implement data solutions using cloud-native technologies like AWS, Databricks, and Snowflake.
  • Develop and optimize complex SQL queries and manage data migration at enterprise scale.
  • Collaborate with Agile teams to drive software and data engineering for a premier banking client.

Kunai builds full-stack technology solutions for banks, credit and payment networks, infrastructure providers, and their customers. Our team thrives in a culture of collaboration, creativity, and continuous learning, with over 20 years of success.