compare
garak vs promptfoo
The same facts for both, read from GitHub every night, and the relation a person reviewed.
| Fact | garak | promptfoo |
|---|---|---|
| Language | Python | TypeScript |
| Licence | Apache-2.0 | MIT |
| Stars | 9.6k | 26k |
| Latest | v0.17.1 | code-scan-action-0.2.2 |
| Last push | 2026-10-16 | 2026-10-19 |
| Release cadence | about 37 days between releases | about 1 day between releases |
| Active contributors | 35 commit authors on the default branch in the last 90 days | 48+ commit authors on the default branch in the last 90 days |
| Flags | none | none |
How they relate
garak replaces promptfoo. Alternatives to promptfoo →
PartialProbes a model for vulnerabilities such as prompt injection and leakage; it does not run general evals.
garak
- v0.17.12026-10-16feat(evaluators): add hit@k attack success rate metric
- v0.17.02026-09-09EU AI Act Mapping
- v0.16.02026-08-04Feature: technique and intent annotation and initial IntentProbe iteration by garak-maintainers in
- v0.15.12026-06-05probes: add ProPILE probes for PII leakage detection
- v0.15.02026-05-01probes: Add multi-turn GOAT probe
promptfoo
- code-scan-action-0.2.22026-10-08code-scan-action: 0.2.2
- 0.124.12026-10-08assertions: record cost without a threshold (#11451) (037f1f6)
- code-scan-action-0.2.12026-10-06code-scan-action: 0.2.1
- 0.124.02026-10-06providers: remove hosted ChatKit provider (#11434)
- 0.123.12026-09-18bedrock: refresh auth across HTTP adapters (#10123) (9d3f063)
garak
✓ signed The latest release, v0.17.1, carries a signature GitHub verified.
Loading the security report
promptfoo
✓ signed The latest release, code-scan-action-0.2.2, carries a signature GitHub verified.
Loading the security report