MMATH
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MMATH
78.4Accuracy
36
MMATH All Languages (test)
28.6Average Score (All)
22
MMATH Out-of-Domain Languages (test)
30.1Vietnamese Accuracy
22
MMATH In-Domain Languages (test)
26.3Accuracy (Ar)
22
MMATH (test)
27.1Accuracy (Ar)
20
MMATH (test)
37.4Ar Score
10
MMath
38.33Accuracy (MMath)
9
MMATH
35.1FR SLC & Acc
8
MMATH
41.2FR Accuracy and SLC
8