alternativa a ChatGPT, Claude

vLLM

1 ferramenta substitui vLLM

SGLangSubstituição completa

SGLang is a high-performance serving framework for large language models and multimodal models.

GPU serving engine for open-weight models behind an OpenAI-compatible API.

Linguagem
Python
Licença
Apache-2.0
Estrelas
37k
Última release
v0.5.21
Último push
2026-10-06

Outras ferramentas em Local model runtimes