promptfoo

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

garak. 1 alternatives to promptfoo, in Python. Compare fit, licence, stars and the latest signed release.

Side by side

1 open source alternative to promptfoo
Tool	Fit	Stars	Licence	Terms	Self-hosted	Language	Latest	Last push
garak	Partial	9.6k	Apache-2.0	Open source	No	Python	v0.17.1	2026-10-16

Every alternative

1 alternative

garak Partial

the LLM vulnerability scanner

Probes a model for vulnerabilities such as prompt injection and leakage; it does not run general evals.

Language: Python
Licence: Apache-2.0
Stars: 9.6k
Latest: v0.17.1
Last push: 2026-10-16

About promptfoo

Language: TypeScript
Licence: MIT
Stars: 26k
Last push: 2026-10-19

About promptfoo →