compare
MLRun vs Triton Inference Server
The same facts for both, read from GitHub every night, and the relation a person reviewed.
| Fact | MLRun | Triton Inference Server |
|---|---|---|
| Language | Python | Python |
| Licence | Apache-2.0 | BSD-3-Clause |
| Stars | 1.7k | 11k |
| Latest | v1.12.0 | v2.73.0 |
| Last push | 2026-10-06 | 2026-10-06 |
| Release cadence | too few releases | about 32 days between releases |
| Active contributors | 21 commit authors on the default branch in the last 90 days | 8 commit authors on the default branch in the last 90 days |
| Flags | none | none |
How they relate
Both replace Amazon SageMaker. Alternatives to Amazon SageMaker →
PartialMLRunPipelines, model serving and monitoring on Kubernetes.
PartialTriton Inference ServerServes TensorRT, PyTorch, ONNX and other models over HTTP and gRPC, with dynamic batching.
MLRun
- v1.12.02026-09-22Jupyter: 1.12.x remediate high cves in jupyter image (#10053), #10081, @GiladShapira94
- v1.13.0-rc92026-09-17APIGateway: Omit authenticationmode when function authentication is enabled, #10112, @Yacoubypre-release
- v1.13.0-rc82026-09-10Dependabot-automated: Bump golang.org/x/sync from 0.22.0 to 0.23.0 in /server/go, #10094, @dependabot[bot]pre-release
- v1.13.0-rc72026-09-02UI: Features & enhancementpre-release
- v1.12.0-rc302026-08-23UI: Features & enhancementpre-release
Triton Inference Server
- v2.73.02026-09-30Release 2.73.0 corresponding to NGC container 26.09
- v2.72.02026-08-31Release 2.72.0 corresponding to NGC container 26.08
- v2.71.02026-07-29Release 2.71.0 corresponding to NGC container 26.07
- v2.70.02026-06-26Release 2.70.0 corresponding to NGC container 26.06
- v2.69.02026-06-02Release 2.69.0 corresponding to NGC container 26.05
MLRun
unsigned The latest release, v1.12.0, carries no signature GitHub could verify.
Loading the security report
Triton Inference Server
✓ signed The latest release, v2.73.0, carries a signature GitHub verified.
Loading the security report