List your company

ResearchFormerly WizWand

MMLU

Benchmarks

TaskDatasetSOTA resultTrendResults

Multi-task Language Understanding

MMLU STEM (test)

72.4Accuracy

2

General Knowledge

MMLU

1.3MMLU General Knowledge Delta (pp)

1

Question Answering

MMLU Biology

0Accuracy

1

Question Answering

MMLU Chemistry

0Calibration Rate

1

Question Answering

MMLU Physics

54Correctness Rate (CR)

1

Question Answering

MMLU CS (LIFO)

0Accuracy (CR)

1

Question Answering

MMLU Math

49Correctness Rate (CR)

1

Language Model Evaluation

MMLU-Pro

77.54AS

1

Symbolic Reasoning

MMLU-Hard abstract_algebra 100 items

41.7Baseline Accuracy

1

Data source relevance classification

MMLU (test)

90.93Accuracy

1

Question Answering

MMLU

83.7Accuracy

1

Multiple Choice Question Answering

MMLU-Pro

32.13Before Score

1

Biomedical Question Answering

MMLU Medical

—Primary metric

0

Multi-task Language Understanding

MMLU

—Primary metric

0

Language Understanding

MMLU

—Primary metric

0

Question Answering

MMLU (test)

—Accuracy (Learned)

0

Knowledge Injection

MMLU

—Learned Knowledge

0

Language Understanding

Global MMLU-Lite 21 (test)

—Score

0