Remote Software engineering Jobs · VLLM

Job listings

$179,000–$199,000/yr

  • Design, build, and maintain foundational AI platform components including model gateways, vector databases, and LLM evaluation frameworks.
  • Develop secure platform architectures with integrated authentication, authorization, and access control mechanisms.
  • Build and enhance observability solutions for AI workloads and partner with teams to integrate AI infrastructure with agent frameworks.

Jobgether is a platform that uses AI-powered matching to connect candidates with job opportunities. It processes applications and shares shortlists with hiring companies, operating as an intermediary in the recruitment process.

  • Build and operate production-grade model serving infrastructure using vLLM, TGI, or Triton frameworks.
  • Design and implement auto-scaling, multi-model architectures, and intelligent request routing for ML inference.
  • Optimize GPU utilization, memory efficiency, and observability to ensure low-latency, cost-effective systems.

They are a distributed cloud infrastructure startup building AI-native cloud services with GPU-powered compute. The company is well-funded, fast-scaling, and operates in a remote-first environment with a focus on sustainability and decentralization.

  • Optimize production LLM serving with vLLM and SGLang to maximize throughput and minimize latency through batching and quantization.
  • Profile training runs to find bottlenecks and resolve them with attention implementations like FlashAttention on H200 and GB200 hardware.
  • Deploy and operate multiple models on shared GPU clusters with autoscaling, bin-packing, and efficient handling of mixed workloads.

Egen is a fast-growing technology company with a data-first mindset, partnering with clients on Google Cloud and Salesforce to drive action through data and insights. We are a team of dedicated engineers who thrive on solving tough problems and continually innovate to achieve fast, effective results.