LM Evaluation Harness
Loading the README
- v0.4.132026-08-31A fix-focused release. The main fixes are for few-shot leakage, a multiple-choice filter bug, and group stderr, alongsi…
- v0.4.122026-05-11New release with four new model backends, tensor parallel support for transformers based models (hf), new benchmarks, a…
- v0.4.112026-02-13Minor release. Stay tuned for bigger changes next release.
- v0.4.102026-01-27The big change this release: the base package no longer installs model backends by default. We've also added new benchm…
- v0.4.9.22025-11-26lm-eval v0.4.9.2 Release Notes
✓ signed The latest release, v0.4.13, carries a signature GitHub verified.
Loading the security report