COPA
Benchmarks
TaskDatasetSOTA resultTrendResults
COPA
99.2Accuracy
288
COPA
95Accuracy
63
COPA
96Accuracy
59
COPA (test)
98.67Accuracy
54
COPA
92.88Accuracy
48
COPA
100Accuracy
42
COPA
99.3EM
32
Copa
92Accuracy
22
Copa100
83Accuracy
12
COPA Far OOD
98Accuracy
10
COPA (dev)
93Accuracy
7
Balanced COPA
70.7Accuracy
6
COPA 2011
79Accuracy
6
COPA 11 languages
55.5Score
5
COPA
5Recovery Score (Grader 1)
4
COPA
100MHA
4
COPA
80Accuracy
3
COPA 5-shot
85Accuracy
3
COPA es
54.4Accuracy
3
COPA en
56Accuracy
3
COPA (dev)
86Accuracy
3
COPA (dev)
65.8Accuracy
3
COPA
100MHA
2
COPA
100MHA
2
COPA
45.5MHA
2