Skip to content

>awesome-alternatives

Search the catalog

Browse About Add a tool

Language

English Français Español Deutsch Português (Brasil)日本語 Bahasa Indonesia

Home
Local model runtimes
Xinference

alternative to ChatGPT

Xinference

Loading the README

v3.5.02026-09-25These are the changes in inference v3.5.0.
v3.4.02026-09-11These are the changes in inference v3.4.0.
v3.3.02026-08-30These are the changes in inference v3.3.0.
v3.2.02026-08-15These are the changes in inference v3.2.0.
v3.1.02026-07-31These are the changes in inference v3.1.0.

✓ signed The latest release, v3.5.0, carries a signature GitHub verified.

Loading the security report

ChatGPTServes open-weight language, embedding and speech models behind an OpenAI-compatible API.Partial

About

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

PythonLocal model runtimesApache-2.0

Owner: Xorbits organisation
Stars: 9.6k
Forks: 873
Latest: v3.5.0
Last push: 2026-10-06
Terms: Open source
Self-hosted: Yes
Deploy with: Container image
Created: 2023, 3 years ago
Release cadence: about 15 days between releases
Active contributors: 38 commit authors on the default branch in the last 90 days

Read from GitHub on 2026-10-06.Entry last edited on 2026-10-06.

Compare Xinference and Ollama →

#artificial-intelligence#deployment#diffusers#gemma#glm#glm-5-3#inference#kimi

github.com/xorbitsai/inference ↗Website ↗Edit this entry Changes to Xinference (RSS)

Other tools in Local model runtimes

OllamaGo→
llama.cppC++→
vLLMPython→
LocalAIGo→
exoPython→
SGLangPython→
llamafileC++→
MLC LLMPython→
KTransformersPython→
TensorRT-LLMPython→
LMDeployPython→
mistral.rsRust→
llama-swapGo→
LemonadeC++→
GPUStackPython→
RamaLamaPython→
TabbyAPIPython→

Catalog CC BY-SA, code AGPL, data from GitHub, every night

How it works What changed RSS feed Contact Legal notice Privacy GitHub ↗