compare

LMDeploy vs TensorRT-LLM

The same facts for both, read from GitHub every night, and the relation a person reviewed.

LMDeploy vs TensorRT-LLM
FactLMDeployTensorRT-LLM
LanguagePythonPython
LicenceApache-2.0Other
Stars8.1k15k
Latestv0.18.0v1.2.1
Last push2026-09-282026-10-06
Release cadenceabout 23 days between releasestoo few releases
Active contributors28 commit authors on the default branch in the last 90 days125+ commit authors on the default branch in the last 90 days
Flagsnonenone
  • Both replace ChatGPT. Alternatives to ChatGPT →

    PartialLMDeployServes open-weight models behind an OpenAI-compatible API, with quantisation and batching.

    PartialTensorRT-LLMServes open-weight models on NVIDIA GPUs behind an OpenAI-compatible API.