MathVerse
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MathVerse (testmini)
71.5Accuracy
18
MathVerse VO
62.8Macro F1
18
MathVerse
67.84Pass@1
17
MathVerse 1.0 (test)
73.01Score
17
MathVerse (testmini)
57.6Mean@1 Accuracy
17
MathVerse testmini
63.8Score
16
MathVerse (testmini)
57Accuracy
16
MathVerse
75.1Accuracy@8
16
MathVerse
62.4Accuracy
14
MathVerse
47.2Pass@1 Accuracy
14
MathVerse mini Vision Only
48.6Avg@3 Score
14
MathVerse vision-only
61.5Accuracy
13
MathVerse mini (test)
59.3Score
13
MathVerse-VO
50.4Score
13
Mathverse solid (test)
92.1Overall Average
12
MathVerse-Plus Vision Only 1.0 (test)
31Accuracy
12
MathVerse-Plus Vision Dominant 1.0 (test)
41Accuracy
12
MathVerse-Plus Text Dominant 1.0 (test)
53Accuracy
12
MathVerse-Plus All 1.0 (test)
43.6Accuracy
12
MathVerse mini-vision
31.2Score
12
MathVerse Vision Dominant (testmini)
19.1CoT-E
11
MathVerse Vision Intensive (testmini)
53.7CoT-E
11
MathVerse Text Lite (testmini)
21.2CoT Error
11
MathVerse Text Dominant (testmini)
65.2CoT-E
11
MathVerse mini All (test)
56.7CoT-E
11