MathVista
Benchmarks
TaskDatasetSOTA resultTrendResults
MathVista GPS (test)
75.96Accuracy
31
MathVista
78.8Score
30
MathVista
75.2Accuracy (%)
29
MathVista
83.97Accuracy
28
MathVista
89.3OpenAI Score
26
MathVista mini
82.9Overall Score
26
MathVista mini
82.5Accuracy
26
MathVista
79.6Avg Pass@8
26
MathVista mini
85.9Accuracy
25
MathVista 96 (testmini)
89.1Score
23
MathVista testmini
63Score
23
MathVista F
49Accuracy
23
MathVista
77.9Accuracy
22
MathVista 14 (1000)
90.2Macro Score
22
MathVista
76.3Score
21
MathVista mini (test)
77.6Accuracy
21
MathVista
60.3Total Accuracy
20
MathVista
72.6Accuracy
19
MathVista Math
81.11ALL Accuracy
19
MathVista
67.5Accuracy
18
MathVista 1.0 (testmini)
67.6Accuracy
18
MathVista
0.735Avg@3
18
MathVista
69.5Pass@1
17
MathVista
76.8Accuracy
17
MathVista
87.15BoN@3 Accuracy
17