compare
vLLM vs Xinference
The same facts for both, read from GitHub every night, and the relation a person reviewed.
| Fact | vLLM | Xinference |
|---|---|---|
| Language | Python | Python |
| Licence | Apache-2.0 | Apache-2.0 |
| Stars | 93k | 9.6k |
| Latest | v0.31.0 | v3.5.0 |
| Last push | 2026-10-06 | 2026-10-06 |
| Release cadence | about 14 days between releases | about 15 days between releases |
| Active contributors | 260+ commit authors on the default branch in the last 90 days | 38 commit authors on the default branch in the last 90 days |
| Flags | none | none |
How they relate
Both replace ChatGPT. Alternatives to ChatGPT →
PartialvLLMServes open-weight models behind an OpenAI-compatible API, tuned for GPU throughput.
PartialXinferenceServes open-weight language, embedding and speech models behind an OpenAI-compatible API.
vLLM
- v0.31.02026-10-05This release features 717 commits from 307 contributors (96 new)!
- v0.30.02026-09-22This release features 762 commits from 315 contributors (104 new)!
- v0.29.02026-09-09This release features 594 commits from 277 contributors (91 new)!
- v0.28.02026-08-26This release features 584 commits from 270 contributors (76 new)!
- v0.27.12026-08-11This is a patch release on top of v0.27.0.
Xinference
vLLM
unsigned The latest release, v0.31.0, carries no signature GitHub could verify.
Loading the security report
Xinference
✓ signed The latest release, v3.5.0, carries a signature GitHub verified.
Loading the security report