High-throughput LLM serving
Open-source inference engine known for PagedAttention and production serving performance.
Open-source inference engine known for PagedAttention and production serving performance.
vLLM is listed in Axioniq’s curated Open Source AI collection. Open-source models, frameworks, and communities that keep the AI ecosystem inspectable and portable.
Open-source models, frameworks, and communities that keep the AI ecosystem inspectable and portable.
Compare peers in Open Source AI or jump straight to the official vLLM site.