Inspect vs OpenCompass: perbandingan

Inspect vs OpenCompass
Fakta	Inspect	OpenCompass
Bahasa	Python	Python
Lisensi	MIT	Apache-2.0
Bintang	3k	7.5k
Terbaru	0.3.281	0.5.4
Push terakhir	2026-10-17	2026-10-16
Frekuensi rilis	sekitar 2 hari antar rilis	sekitar 89 hari antar rilis
Kontributor aktif	81+ penulis commit di branch default dalam 90 hari terakhir	26 penulis commit di branch default dalam 90 hari terakhir
Peringatan	tidak ada	tidak ada

Hubungan keduanya

Keduanya menggantikan LM Evaluation Harness. Alternatif LM Evaluation Harness →
SebagianInspectRuns benchmark tasks, but is built around custom evals and agents.
Pengganti penuhOpenCompassRuns benchmark suites over local and API models from a config.

0.3.2812026-10-15v0.3.281
0.3.2802026-10-14v0.3.280
0.3.2792026-10-12v0.3.279
0.3.2782026-10-09Tasks and samples can carry a description of what they ask of the agent, recorded in the eval log and in evals_df() and…

0.5.42026-08-26✨ Multimodal Evaluation with VLMEvalKit: OpenCompass now integrates VLMEvalKit for native multimodal dataset loading, O…
0.5.32026-06-29✨ 🧪 Extensive New Benchmarks and Dataset Support: Added support for a wide range of new benchmarks and datasets, inclu…
0.5.22026-02-14✨ 🧪 Extensive New Benchmarks Support: We have introduced comprehensive support for Scientific and General Benchmarks,…
0.5.1.post12025-10-17✨ A New Method to quickly Integrate and Evaluate Your Datasets: Added a fast dataset integration and evaluation method…
0.5.02025-09-01✨ Comprehensive Scientific Benchmarks: Integrated 10+ specialized datasets (MedXpertQA, ClimaQA, SmolInstruct, etc.),…

✓ bertanda tangan Rilis terbaru, 0.3.281, memiliki tanda tangan yang diverifikasi GitHub.

Memuat laporan keamanan

✓ bertanda tangan Rilis terbaru, 0.5.4, memiliki tanda tangan yang diverifikasi GitHub.

Memuat laporan keamanan