🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.
- Language
- TypeScript
- Licence
- Other
- Stars
- 35k
- Latest
- v4.53.0
- Last push
- 2026-10-06
LLM observability
Trace, evaluate and monitor LLM applications.
Changes in this category (RSS)
Side by side
| Tool | Stars | Licence | Terms | Self-hosted | Language | Latest | Last push |
|---|---|---|---|---|---|---|---|
| Langfuse | 35k | Other | Open core | Yes | TypeScript | v4.53.0 | 2026-10-06 |
| Opik | 22k | Apache-2.0 | Open source | Yes | Python | 2.2.92 | 2026-10-06 |
| Arize Phoenix | 12k | Other | Source available | Yes | Python | arize-phoenix-v20.19.0 | 2026-10-06 |
| Evidently | 8k | Apache-2.0 | Open source | Yes | Jupyter Notebook | v0.7.23 | 2026-09-29 |
| Helicone | 6.2k | Apache-2.0 | Open source | Yes | TypeScript | v2025.08.21-1 | 2026-09-16 |
| LangWatch | 4.9k | Apache-2.0 | Open source | Yes | TypeScript | langwatch-3.20.1 | 2026-10-06 |
| Agenta | 4.8k | Other | Open core | Yes | TypeScript | v0.122.1 | 2026-10-06 |
| Laminar | 3.3k | Apache-2.0 | Open source | Yes | TypeScript | v0.2.5 | 2026-10-06 |
| OpenLIT | 2.8k | Apache-2.0 | Open source | Yes | TypeScript | openlit-2.1.0 | 2026-10-05 |
9 tools
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
- Language
- Python
- Licence
- Apache-2.0
- Stars
- 22k
- Latest
- 2.2.92
- Last push
- 2026-10-06
AI Observability & Evaluation
- Language
- Python
- Licence
- Other
- Stars
- 12k
- Latest
- arize-phoenix-v20.19.0
- Last push
- 2026-10-06
Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
- Language
- Jupyter Notebook
- Licence
- Apache-2.0
- Stars
- 8k
- Latest
- v0.7.23
- Last push
- 2026-09-29
🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓
- Language
- TypeScript
- Licence
- Apache-2.0
- Stars
- 6.2k
- Latest
- v2025.08.21-1
- Last push
- 2026-09-16
Open-Source Agent Observability & Evals for AI Platform teams. Trace, test, route and govern every agent & coding assistant in the company.
- Language
- TypeScript
- Licence
- Apache-2.0
- Stars
- 4.9k
- Latest
- langwatch-3.20.1
- Last push
- 2026-10-06
Agenta is a workspace where you and your team build agents and automations.
- Language
- TypeScript
- Licence
- Other
- Stars
- 4.8k
- Latest
- v0.122.1
- Last push
- 2026-10-06
Laminar - open-source observability platform purpose-built for AI agents. YC S24.
- Language
- TypeScript
- Licence
- Apache-2.0
- Stars
- 3.3k
- Latest
- v0.2.5
- Last push
- 2026-10-06
OpenLIT is the open-source agent harness engineering platform: trace, evaluate, guard, and improve everything around the model in your AI agents, on OTEL.
- Language
- TypeScript
- Licence
- Apache-2.0
- Stars
- 2.8k
- Latest
- openlit-2.1.0
- Last push
- 2026-10-05