OSS
vLLM Trends at 78,289 Stars as the Dominant Open-Source LLM Inference Engine — Blackwell GPU and DeepSeek V3 Support Drive Adoption
vLLM continues trending as the go-to high-throughput, memory-efficient inference and serving engine for large language models, now at 78,289 stars. The project has expanded hardware support to include NVIDIA Blackwell GPUs and model support for DeepSeek V3, AMD accelerators, and other recent architectures. For builders running local or self-hosted LLM infrastructure, vLLM remains the production standard.
Source
↳ Follow the thread