XCOPA
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
XCOPA
94.4Accuracy
55
XCOPA
74.5Accuracy
35
XCOPA (test)
96.4Accuracy (th)
31
XCOPA
99Accuracy (ZH)
14
XCOPA
55.5Accuracy (zh)
12
XCOPA 1.0 (test)
54.5Accuracy
11
XCOPA
1.96MAE
9
XCOPA
2.59MAE
9
XCOPA ET
71.8Accuracy
8
XCOPA
64.2XCOPA Causal Reasoning Score
8
XCOPA
73Accuracy
6
XCOPA
63.36Accuracy
5
XCOPA
62.9Extract Match Score
4
XCOPA (test)
99.31Language Democratization
4
XCOPA Thai
60Accuracy
3
XCOPA Indonesian
60Accuracy
3
XCOPA 74 (test)
—Score
0
XCOPA Māori
—Accuracy
0