Similar Jobs
See allSoftware Engineer (L3) Infrastructure
Twilio
Canada
Typescript
Python
Go
Software Engineer
OpenRouter
US
TypeScript
API Design
Developer Experience
Platform Engineer
Vantage
US
Kubernetes
Terraform
Postgres
Senior AI Engineer
UJET
US
Python
TypeScript
SQL
Senior Software Engineer
Valon
US
AWS
GCP
Azure
Role Overview:
- You will own and scale the systems routing millions of LLM requests daily on the Platform team.
- Work hands-on with a small team on infrastructure, datastores, and CI/CD pipelines.
Key Responsibilities:
- Scale edge and cloud infrastructure across Cloudflare, Google Cloud, and Vercel.
- Ensure performance optimization for LLM inference as traffic grows rapidly.
- Set patterns for infrastructure operations, tooling, observability, and on-call processes.
Qualifications:
- 5+ years experience building production infrastructure where uptime, latency, and cost are critical.
- Expertise with cloud platforms and edge-first serverless platforms like Cloudflare Workers.
- Ability to operate large-scale databases and move across a full-stack TypeScript environment.
OpenRouter
OpenRouter is the leading AI routing and infrastructure layer that enterprises use to manage and optimize large language models across providers without lock-in or capacity constraints. It powers advanced AI teams with a flexible and future-proof platform for operationalizing LLMs across various workloads.