Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

MMLU dataset and benchmarks – Page 16 · SOTA2 Research

Research Datasets

MMLU

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

general multi-choice

MMLU-Pro

49.4Science Accuracy

14

Multi-task Language Understanding

MMLU Pro

57.6Accuracy

14

Multitask Language Understanding

MMLU Spanish (test)

77Accuracy

14

Multi-task Language Understanding

MMLU

64.29MMLU Score

14

MMLU (val)

69.12MMLU STEM Accuracy

14

Multi-task Language Understanding

MMLU

69.5MMLU Score

14

Massive Multitask Language Understanding

MMLU

61.9MMLU FL Score

14

MMLU-PRO (val)

91.5Top-1 Acc

14

MMLU-PRO

91.5Top-1 Acc

14

MMLU

58MMLU Factual Recall Accuracy

14

General language understanding and reasoning

MMLU-Redux

83.7Accuracy

14

MMLU-Redux2

91.67PAQ

14

Question Answering

MMLU

65.98Vanilla Accuracy

14

Multiple-Choice Question Answering

MMLU STEM (test)

65.6Accuracy (ACC)

13

Multiple-Choice Question Answering

MMLU Social Sciences (test)

79.12Accuracy

13

Multiple-Choice Question Answering

MMLU Humanities (test)

62.47Accuracy (Humanities)

13

Language Understanding

MMLU Five-client Non-IID (test)

48.5Law/Eth Score

13

English Knowledge

MMLU-Redux

90.15Accuracy (English Knowledge)

13

Multi-task Language Understanding

MMLU STEM

89.1Accuracy

13

Multiple Choice Question Answering

MMLU-Redux (test)

84.54Accuracy

13

Knowledge Preservation and Reasoning

MMLU

61.46MMLU Score

13

Question Answering

MMLU

89.2MMLU Accuracy

13

Question Answering

MMLU

75.5MMLU Accuracy

12

Science Reasoning

MMLU Pro

66.49Accuracy

12

Scientific Reasoning

MMLU-Pro

25.96Mean Score @16

12

Page 16 of 40

Popular tasks

Language Understanding Multi-task Language Understanding Question Answering Multiple-choice Question Answering Multitask Language Understanding

Follow for updates

Join SOTA2 Contact