Sentence Completion on P3
85.3COPA AccuracymT-En
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| mT-Enmode=zero-shot, protocol=cross-lingual generalization2024.06 | 85.3 | 34.9 | 94.7 | 71.6 | |
| mT-Ko-CTmode=zero-shot, protocol=cross-lingual generalization2024.06 | 66.3 | 31.8 | 67.6 | 55.2 | |
| mT-Komode=zero-shot, protocol=cross-lingual generalization2024.06 | 63.7 | 28.9 | 59.1 | 50.6 | |
| mT-Ko-CImode=zero-shot, protocol=cross-lingual generalization2024.06 | 63.3 | 35.4 | 67.3 | 55.3 | |
| mT5mode=zero-shot, protocol=cross-lingual generalization2024.06 | 56 | 26 | 49.9 | 44 |