vLLM: open source alternative to ChatGPT and Claude

SGLang is a high-performance serving framework for large language models and multimodal models.

GPU serving engine for open-weight models behind an OpenAI-compatible API.

Loading the README

v0.31.02026-10-05This release features 717 commits from 307 contributors (96 new)!
v0.30.02026-09-22This release features 762 commits from 315 contributors (104 new)!
v0.29.02026-09-09This release features 594 commits from 277 contributors (91 new)!
v0.28.02026-08-26This release features 584 commits from 270 contributors (76 new)!
v0.27.12026-08-11This is a patch release on top of v0.27.0.

unsigned The latest release, v0.31.0, carries no signature GitHub could verify.

Loading the security report

ChatGPTServes open-weight models behind an OpenAI-compatible API, tuned for GPU throughput.Partial
ClaudeServes open-weight models behind an OpenAI-compatible API.Partial

vLLM