PolyMath
Benchmarks
TaskDatasetSOTA resultTrendResults
PolyMath (test)
20.3Accuracy (Ar)
30
PolyMath 5 Unseen Languages
51.3PolyMath Score
20
PolyMath 8 Seen Languages
50PolyMath Score
20
PolyMath High
73.74Macro F1
12
PolyMath Medium
75.22Macro F1
12
PolyMath Low
87.64Macro F1 Score
12
PolyMath
20.9Accuracy
12
PolyMath medium ALL 1.0 (test)
25.24Accuracy
12
PolyMath medium (EN) 1.0 (test)
32Accuracy
12
PolyMath English
44Pass@1
9
PolyMath Full
18.9Accuracy (ar)
7
Polymath Low
96.5Accuracy (en)
3
Polymath Low
96.8Accuracy (en)
3