Buoyant Releases Kinference Control Plane for vLLM on Kubernetes
Buoyant has released Kinference, an Apache 2.0-licensed open-source control plane for vLLM deployments on Kubernetes. The Rust-based project sits ahead of vLLM workers and uses declarative policies to route requests, apply token-rate limits, balance traffic using KV-cache data, and provide per-tenant metrics. The current release is v0.1.0-alpha.7 and is configured through five Kubernetes custom resources.