MathVerse
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MathVerse
84.1Accuracy
266
MathVerse
81.4Accuracy
259
MathVerse
78.8Accuracy
194
MathVerse
68.5Accuracy
138
MathVerse mini
82.6Accuracy
89
MathVerse
62.4Average Score
70
MathVerse Vision Only
67Accuracy
58
MathVerse V
67.8Accuracy
49
MathVerse mini
65.9Accuracy
45
MathVerse
61.29Accuracy
40
MathVerse
82.9Accuracy
37
MathVerse-V
81.2Accuracy
33
MathVerse (test)
64.9Accuracy (ALL)
33
MathVerse VO
70.46BoN@8 Accuracy
29
MathVerse
91.62Accuracy
28
MathVerse (testmini)
64.9Accuracy
28
MathVerse
60.95Mean@8 Accuracy
26
MathVerse mini (test)
70.94T-Dominant Score
26
MathVerse mini (test)
66.9Accuracy
26
MathVerse MINI
77.7Accuracy
25
MathVerse vision-only (testmini)
43Accuracy
22
MathVerse VO
48.71FEI Score
20
MATHVERSE Solid Geometry
80Compilation Success
20
MathVerse Vision Only
58.76Accuracy
19
MathVerse vision-only
54.6Accuracy
18