Macro Average

Macro-average (Mathematics, Multi-Hop QA, Code Generation)

21

Macro Average (Across Datasets)

18

Macro Average AIME2024, MATH, Minerva, Olympiad-Bench

16

Macro Average Selected Benchmarks

14

Macro-Average

11

Macro-average SICKR-STS, STS-B, WMT_RU_EN, WMT_EN_ZH, WMT_SI_EN (test)

11

Macro-average

10

Macro-average (MMLU, MATH, GSM8K, BBH)

8

Macro-average 5 NDAs (Avg)

6

Macro-average over six benchmarks

6

Macro Average (PubMedQA, WebShop, ToolEmu)

5

Macro Average Zero-shot

4

Macro Average In-domain

4