The Triton Inference Server provides an optimized cloud and edge inferencing solution.
Serves TensorRT, PyTorch, ONNX and other models over HTTP and gRPC, with dynamic batching.
- Lenguaje
- Python
- Licencia
- BSD-3-Clause
- Estrellas
- 11k
- Última versión
- v2.73.0
- Último push
- 2026-10-06