The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
LLM gateways
One OpenAI-compatible API in front of many model providers, with keys, budgets, fallbacks and usage logs.
Perubahan di kategori ini (RSS)
Perbandingan berdampingan
| Alat | Bintang | Lisensi | Ketentuan | Self-hosted | Bahasa | Terbaru | Push terakhir |
|---|---|---|---|---|---|---|---|
| LiteLLM | 60k | Other | Open core | Ya | Python | v1.104.0 | 2026-10-06 |
| New API | 49k | AGPL-3.0 | Open source | Ya | Go | v1.0.0-rc.41 | 2026-10-06 |
| Portkey Gateway | 13k | MIT | Open source | Ya | TypeScript | v1.15.2 | 2026-05-25 |
| Bifrost | 8.6k | Apache-2.0 | Open source | Ya | Go | ent-v2.2.6-base | 2026-10-06 |
4 alat
A unified AI model hub for aggregation & distribution. It supports cross-converting various LLMs into OpenAI-compatible, Claude-compatible, or Gemini-compatible formats. A centralized gateway for personal and enterprise model management.
- Bahasa
- Go
- Lisensi
- AGPL-3.0
- Bintang
- 49k
- Terbaru
- v1.0.0-rc.41
- Push terakhir
- 2026-10-06
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
- Bahasa
- TypeScript
- Lisensi
- MIT
- Bintang
- 13k
- Terbaru
- v1.15.2
- Push terakhir
- 2026-05-25
Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.
- Bahasa
- Go
- Lisensi
- Apache-2.0
- Bintang
- 8.6k
- Terbaru
- ent-v2.2.6-base
- Push terakhir
- 2026-10-06