MMLU

MMLU Pro (test)

5

MMLU in-distribution

5

MMLU-pro

5

MMLU L-M pair

5

MMLU M-Q pair

5

MMLU L-Q pair

5

MMLU-Pro

5

MMLU

5

MMLU (test)

5

MMLU redux

5

MMLU and MMLU-Pro on LLM Workloads (GPT-2 Large, LLaMA 3.1 8B, DeepSeek-V2 7B)

5

MMLU-Pro

5

MMLU STEM (test)

5

MMLU Chemistry

4

MMLU-Pro Computer Science

4

MMLU CS (Computer Science)

4

MMLU-Pro Biomedical

4

MMLU Biomedical

4

MMLU last 25% (test)

4

MMLU-Pro

4

MMLU

4

MMLU Pro

4

MMLU

4

MMLU-Pro

4

MMLU Medical (test)

4