alternativa a ChatGPT, Claude

vLLM

1 herramienta sustituye a vLLM

SGLangSustitución completa

SGLang is a high-performance serving framework for large language models and multimodal models.

GPU serving engine for open-weight models behind an OpenAI-compatible API.

Lenguaje
Python
Licencia
Apache-2.0
Estrellas
37k
Última versión
v0.5.21
Último push
2026-10-06

Más en Local model runtimes