XCOPA
Benchmarks
TaskDatasetSOTA resultTrendResults
XCOPA
94.4Accuracy
55
XCOPA
74.5Accuracy
35
XCOPA (test)
96.4Accuracy (th)
31
XCOPA
99Accuracy (ZH)
14
XCOPA
55.5Accuracy (zh)
12
XCOPA 1.0 (test)
54.5Accuracy
11
XCOPA
1.96MAE
9
XCOPA
2.59MAE
9
XCOPA ET
71.8Accuracy
8
XCOPA
64.2XCOPA Causal Reasoning Score
8
XCOPA
73Accuracy
6
XCOPA
63.36Accuracy
5
XCOPA
62.9Extract Match Score
4
XCOPA (test)
99.31Language Democratization
4
XCOPA Thai
60Accuracy
3
XCOPA Indonesian
60Accuracy
3
XCOPA 74 (test)
—Score
0
XCOPA Māori
—Accuracy
0