alternatives à

vLLM

A high-throughput and memory-efficient inference and serving engine for LLMs

Côte à côte

1 alternative open source à vLLM
OutilRemplacementÉtoilesLicenceConditionsAuto-hébergeableLangageDernière releaseDernier push
SGLangRemplacement complet37kApache-2.0Open sourceOuiPythonv0.5.212026-10-06

Toutes les alternatives

1 alternative

SGLangRemplacement complet

SGLang is a high-performance serving framework for large language models and multimodal models.

GPU serving engine for open-weight models behind an OpenAI-compatible API.

Langage
Python
Licence
Apache-2.0
Étoiles
37k
Dernière release
v0.5.21
Dernier push
2026-10-06

À propos de vLLM

Langage
Python
Licence
Apache-2.0
Étoiles
93k
Dernier push
2026-10-06

À propos de vLLM →