A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
Runs large mixture-of-experts models split across CPU and GPU, on top of its own optimized kernels.
- Lenguaje
- Python
- Licencia
- Apache-2.0
- Estrellas
- 20k
- Última versión
- v0.7.2
- Último push
- 2026-10-16