Matcha
Matcha.fm
Inferact logo

Member of Technical Staff, CI/CD Infrastructure

Inferact

Apply

Startup to grow vLLM as world's leading, cheaper AI inference.

$150M Seed Round raised· Backed by Lightspeed Venture Partners
$200k - $400kFULL TIMERemote · US28 employees
dockerkubernetesgithub actionsbuildkitepythonbashgolinuxci/cd pipeline designcompute orchestrationcontainerizationnetworkingstoragepackage managementcudarocm

Remote startup roles in your inbox

Matcha reads all job descriptions to surface the handful that actually matter in a zero noise email. Simple by design.

Describe your next role, be picky

Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware—a position that took years to build.

About the Role

vLLM is growing at a fast pace, and every bit of that growth lands on the CI system. More models, more hardware, more contributors, more ways for things to break. Your job is to make sure none of that slows anyone down.

You’ll get to:

  • Maintain and scale the compute infrastructure that powers CI, release, performance benchmark, accuracy evaluation for vLLM project, across a wide range of models and accelerators including H100/H200, (G)B200/300, AMD MI325/355X, TPU, Intel Gaudi, etc..

  • Get creative about cutting CI time-to-signal from hours to minutes

  • Make sure every corner of vLLM code base is well-tested

  • Keep vLLM releases rock-solid

  • Build out tooling that helps 3,000+ vLLM contributors move fast

Skills and Qualifications

Minimum qualifications:

  • Strong experience with Docker, Kubernetes, and containerized build or test environments.

  • Built CI/CD pipelines from scratch using GitHub Actions, Buildkite, or similar systems.

  • Familiar with CI design patterns and CI techniques: compute orchestration, handling flaky tests, dependency/environment management, caching, remote execution, test target determination, etc, test coverage, and so on.

  • Fluent in Python, Bash, Go, or similar for automation and tooling.

  • Solid fundamentals of Linux, security, networking, storage, package management,.

Bonus points for:

  • Setting up infrastructure for ML, inference, CUDA, ROCm, or accelerator-heavy workloads.

  • Running Buildkite at scale, including agents, queues, dynamic pipelines, test sharding, caching, and artifact management.

  • Operating Kubernetes clusters for CI, batch jobs, test execution, or internal developer infrastructure.

  • Managing CI/CD in large open-source project

  • Building dashboards, alerts, runbooks, or tooling for CI observability.

Logistics

  • Location: This role is based in San Francisco, California. Will consider remote in the US for exceptional candidates.

  • Compensation: Depending on background, skills, and experience, the expected annual salary range for this position is $200,000 - $400,000 USD + equity.

  • Visa sponsorship: We sponsor visas on a case-by-case basis.

  • Benefits: Inferact offers generous health, dental, and vision benefits as well as 401(k) company match.