MathVerse
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MathVerse (vision)
76.39Pass@1 Accuracy
11
MathVerse VO
52Score
11
MathVerse Text Only (testmini)
62.1CoT-E
10
MathVerse
68.58Avg@8 Accuracy
10
MathVerse
80.1Avg@8 Score
10
MATHVERSE Function
100Compile Rate
10
MATHVERSE Plane Geometry
76Compile Rate
10
MathVerse mini
64.2Accuracy
9
MathVerse
68.91Pass@5
8
MathVerse
61.52Accuracy
8
MathVerse
63.9Score
7
MathVerse VO
73.85Top-1 Accuracy
7
MathVerse-VD
79.63Top-1 Accuracy
7
MathVerse Vision-Only (testmini)
91Top-1 Accuracy
7
MathVerse (test)
68.1Accuracy
6
MathVerse
52.1Score
6
MathVerse
56.7Avg@32 Accuracy
6
MathVerse mini-vis
37.1Accuracy
6
MathVerse out-of-distribution
51.35Accuracy
6
MathVerse VO
29.6FISI F1 Score
6
MathVerse
-0.01Spearman Rank Correlation (Acc)
5
MathVerse
18.22Throughput (TPS)
5
MathVerse vision-mini
50.2Accuracy
5
MathVerse
28.6Accuracy
4
MathVerse Vision-only 35
85.91Macro Avg Score
4