Fast, flexible LLM inference
Runs text, vision and speech models locally behind an OpenAI-compatible API, without a desktop app.
Alternativen zu
LM Studio
Desktop app to download and run open-weight language models locally, with a chat window and a local API server. Ein geschlossenes Produkt von Element Labs.
Im Vergleich
| Tool | Ersatzgrad | Sterne | Lizenz | Bedingungen | Selbst hostbar | Sprache | Neuestes Release | Letzter Push |
|---|---|---|---|---|---|---|---|---|
| mistral.rs | Teilweise | 7.7k | MIT | Open Source | Ja | Rust | v0.9.4 | 2026-10-01 |
| Lemonade | Teilweise | 5.8k | Apache-2.0 | Open Source | Ja | C++ | v2026.40.0 | 2026-10-06 |
| RamaLama | Teilweise | 3.1k | MIT | Open Source | Ja | Python | v0.25.0 | 2026-10-05 |
Alle Alternativen
3 Alternativen
Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
A local server and app for running models, tuned for AMD GPUs and NPUs.
- Sprache
- C++
- Lizenz
- Apache-2.0
- Sterne
- 5.8k
- Neuestes Release
- v2026.40.0
- Letzter Push
- 2026-10-06
RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.
Pulls and runs models in containers from the command line, behind an OpenAI-compatible API.
Direkt verglichen
Über LM Studio
- Anbieter
- Element Labs