LM Evaluation Harness

README を読み込み中

1. v0.4.132026-08-31A fix-focused release. The main fixes are for few-shot leakage, a multiple-choice filter bug, and group stderr, alongsi…
2. v0.4.122026-05-11New release with four new model backends, tensor parallel support for transformers based models (hf), new benchmarks, a…
3. v0.4.112026-02-13Minor release. Stay tuned for bigger changes next release.
4. v0.4.102026-01-27The big change this release: the base package no longer installs model backends by default. We've also added new benchm…
5. v0.4.9.22025-11-26lm-eval v0.4.9.2 Release Notes