Average

Average MuSiQue, 2wiki, HotpotQA

27

Average Test100, Test1200, Rain100H, Rain100L (test)

27

Average (Febrl4, F.-Zagat, Bikes, eBooks, Movies)

26

Average Arithmetic Reasoning Tasks

26

Average dataset-weighted (test)

26

Average

26

Average

26

Average AIME24, AIME25, AMC23, MATH500

26

Average across all benchmarks

26

Average across Deraining Datasets (test)

26

Average

25

Average All Datasets

25

Average (MATH500, AMC23, AIME24, AIME25, GPQA-d)

25

Average VideoMME, LongVideoBench, MLVU

25

Average (NQ, TabMWP, HotpotQA, TriviaQA, TriState)

24

Average (MATH-OAI, Minerva Math, OlympiadBench, AIME24, AMC23)

24

Average (TriviaQA, HotpotQA, 2Wiki, Musique, Bamboogle)

24

Average Six Benchmarks

24

Average

24

Average

24

Average StrategyQA, HotpotQA, NQ, Bamboogle

24

Average (2WikiMQA, Bamboogle, Frames, MuSiQue)

24

Average (Vicuna, Self-instruct, Dolly, BPO) (test)

24

Average (Emotion, Irony, Stance, MRPC, RTE)

24

Average Post-processed

23