compare
BentoML vs MLServer
The same facts for both, read from GitHub every night, and the relation a person reviewed.
| Fact | BentoML | MLServer |
|---|---|---|
| Language | Python | Python |
| Licence | Apache-2.0 | Apache-2.0 |
| Stars | 8.9k | 900 |
| Latest | v1.4.39 | 1.7.1 |
| Last push | 2026-10-05 | 2026-10-05 |
| Release cadence | about 25 days between releases | about 95 days between releases |
| Active contributors | 2 commit authors on the default branch in the last 90 days | 0 commit authors on the default branch in the last 90 days |
| Flags | none | none |
How they relate
Both replace Amazon SageMaker. Alternatives to Amazon SageMaker →
PartialBentoMLPackages models as API services and container images to run anywhere.
PartialMLServerA Python inference server speaking the V2 inference protocol.
BentoML
- v1.4.392026-05-07ci: pre-commit autoupdate [skip ci] by @pre-commit-ci[bot] in
- v1.4.382026-04-02feat: native support for src-layout projects
- v1.4.372026-03-25docs: Update slack to forum link
- v1.4.362026-03-06fix: correct typo 'seperators' to 'separators'
- v1.4.352026-02-03fix(client): recreate connector on session refresh to prevent closed session errors
MLServer
- 1.7.12025-06-06Set a lower bound for mlflow in mlserver-mlflow
- 1.7.02025-04-11MLServer has now support for Python 3.11 and 3.12 by @shivakrishnaah in (#1951)
- 1.6.12024-09-10MLServer now offers an option to use pre-existing Python environments by specifying a path to the environment to be use…
- 1.6.02024-06-26MLServer supports Pydantic V2.
- 1.5.02024-03-05Update CHANGELOG
BentoML
✓ signed The latest release, v1.4.39, carries a signature GitHub verified.
Loading the security report
MLServer
unsigned The latest release, 1.7.1, carries no signature GitHub could verify.
Loading the security report