vLLM: Open-Source-Alternative zu ChatGPT und Claude

SGLang is a high-performance serving framework for large language models and multimodal models.

GPU serving engine for open-weight models behind an OpenAI-compatible API.

Die README wird geladen

v0.31.02026-10-05This release features 717 commits from 307 contributors (96 new)!
v0.30.02026-09-22This release features 762 commits from 315 contributors (104 new)!
v0.29.02026-09-09This release features 594 commits from 277 contributors (91 new)!
v0.28.02026-08-26This release features 584 commits from 270 contributors (76 new)!
v0.27.12026-08-11This is a patch release on top of v0.27.0.

unsigniert Das neueste Release, v0.31.0, trägt keine Signatur, die GitHub prüfen könnte.

Der Sicherheitsbericht wird geladen

ChatGPTServes open-weight models behind an OpenAI-compatible API, tuned for GPU throughput.Teilweise
ClaudeServes open-weight models behind an OpenAI-compatible API.Teilweise

vLLM