vLLM: alternatif open source untuk ChatGPT dan Claude

SGLang is a high-performance serving framework for large language models and multimodal models.

GPU serving engine for open-weight models behind an OpenAI-compatible API.

Memuat README

v0.31.02026-10-05This release features 717 commits from 307 contributors (96 new)!
v0.30.02026-09-22This release features 762 commits from 315 contributors (104 new)!
v0.29.02026-09-09This release features 594 commits from 277 contributors (91 new)!
v0.28.02026-08-26This release features 584 commits from 270 contributors (76 new)!
v0.27.12026-08-11This is a patch release on top of v0.27.0.

tanpa tanda tangan Rilis terbaru, v0.31.0, tidak memiliki tanda tangan yang dapat diverifikasi GitHub.

Memuat laporan keamanan

ChatGPTServes open-weight models behind an OpenAI-compatible API, tuned for GPU throughput.Sebagian
ClaudeServes open-weight models behind an OpenAI-compatible API.Sebagian

vLLM