MathVista
Benchmarks
TaskDatasetSOTA resultTrendResults
MathVista
62.36Score
12
MathVista
63.7MathVista Score
11
MathVista
73.6Strict Accuracy
11
MathVista
81.9Accuracy
10
MathVista
3.37Coherence
10
MathVista
69.53Avg@8 Accuracy
10
MathVista
86.1ALG Pass@1
10
MathVista
65DACC
8
MathVista
60.1MathVista Score
8
MathVista
69.3Accuracy
8
MathVista
79.85Accuracy
8
MathVista
2.62Speedup Ratio
8
MathVista
68.25Accuracy
8
MathVista
80.9Pass@5
8
MathVista
89.8Pass@1
7
MathVista
70.5Score
7
MathVista (test)
34.6Accuracy
7
MathVista
0.92Spearman Correlation (10% subset)
7
MathVista mini (full)
77.1Score
7
MathVista 2023 (mini)
62.8Score
7
MathVista mini
56.7Score
6
MathVista
3.9Gain Score
6
MathVista GPS (N=208)
97.6Top-1 Accuracy
6
MathVista
78.4Score
6
MathVista
71.8Avg@32
6