A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
Runs large mixture-of-experts models split across CPU and GPU, on top of its own optimized kernels.
- Langage
- Python
- Licence
- Apache-2.0
- Étoiles
- 20k
- Dernière release
- v0.7.2
- Dernier push
- 2026-10-16