The Triton Inference Server provides an optimized cloud and edge inferencing solution.
Serves TensorRT, PyTorch, ONNX and other models over HTTP and gRPC, with dynamic batching.
- Linguagem
- Python
- Licença
- BSD-3-Clause
- Estrelas
- 11k
- Última release
- v2.73.0
- Último push
- 2026-10-06