MathVerse
Benchmarks
TaskDatasetSOTA resultTrendResults
MathVerse
84.1Accuracy
266
MathVerse
81.4Accuracy
259
MathVerse
78.8Accuracy
194
MathVerse
68.5Accuracy
138
MathVerse mini
82.6Accuracy
89
MathVerse
62.4Average Score
70
MathVerse Vision Only
67Accuracy
58
MathVerse V
67.8Accuracy
49
MathVerse mini
65.9Accuracy
45
MathVerse
61.29Accuracy
40
MathVerse
82.9Accuracy
37
MathVerse-V
81.2Accuracy
33
MathVerse (test)
64.9Accuracy (ALL)
33
MathVerse VO
70.46BoN@8 Accuracy
29
MathVerse
91.62Accuracy
28
MathVerse (testmini)
64.9Accuracy
28
MathVerse
60.95Mean@8 Accuracy
26
MathVerse mini (test)
70.94T-Dominant Score
26
MathVerse mini (test)
66.9Accuracy
26
MathVerse MINI
77.7Accuracy
25
MathVerse vision-only (testmini)
43Accuracy
22
MathVerse VO
48.71FEI Score
20
MATHVERSE Solid Geometry
80Compilation Success
20
MathVerse Vision Only
58.76Accuracy
19
MathVerse vision-only
54.6Accuracy
18