MMLU-Redux
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MMLU-Redux Generative
87.8Humanities Accuracy
16
MMLU-Redux 2.0 (Continual)
33.49Accuracy
6
MMLU-Redux 2.0 (Original)
42.03Accuracy
6
MMLU-Redux OOD
52.5CPT (80%)
4
Loading the SOTA2 catalog…