Skip to content

>awesome-alternatives

Search the catalog

Browse About Add a tool

Language

English Français Español Deutsch Português (Brasil)日本語 Bahasa Indonesia

Home
Local model runtimes
LMDeploy

alternative to ChatGPT

LMDeploy

Loading the README

v0.18.02026-09-28[Feat]: Support output input logprobs
v0.17.02026-09-01Integrate DeepEPv2
v0.16.02026-08-19Support Interns2 mobius
v0.15.02026-07-31Support long-context and MTP prefix-cache hits
v0.14.02026-06-24FP8 kv cache quantization

✓ signed The latest release, v0.18.0, carries a signature GitHub verified.

Loading the security report

ChatGPTServes open-weight models behind an OpenAI-compatible API, with quantisation and batching.Partial

About

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

PythonLocal model runtimesApache-2.0

Owner: InternLM organisation
Stars: 8.1k
Forks: 759
Latest: v0.18.0
Last push: 2026-09-28
Terms: Open source
Self-hosted: Yes
Deploy with: Container image
Created: 2023, 3 years ago
Release cadence: about 23 days between releases
Active contributors: 28 commit authors on the default branch in the last 90 days

Read from GitHub on 2026-10-06.Entry last edited on 2026-10-06.

Compare LMDeploy and Ollama →

#codellama#cuda-kernels#deepspeed#fastertransformer#internlm#llama#llama2#llama3

github.com/InternLM/lmdeploy ↗Website ↗Edit this entry Changes to LMDeploy (RSS)

Other tools in Local model runtimes

OllamaGo→
llama.cppC++→
vLLMPython→
LocalAIGo→
exoPython→
SGLangPython→
llamafileC++→
MLC LLMPython→
KTransformersPython→
TensorRT-LLMPython→
XinferencePython→
mistral.rsRust→
llama-swapGo→
LemonadeC++→
GPUStackPython→
RamaLamaPython→
TabbyAPIPython→

Catalog CC BY-SA, code AGPL, data from GitHub, every night

How it works What changed RSS feed Contact Legal notice Privacy GitHub ↗