Multiple-Choice Question Answering on P3
77.6DreammT-En
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| mT-Enmode=zero-shot, protocol=cross-lingual generalization2024.06 | 77.6 | 78.2 | 61.1 | 93.8 | 47.7 | 71.7 | |
| mT-Ko-CTmode=zero-shot, protocol=cross-lingual generalization2024.06 | 74.8 | 77.8 | 62.3 | 91.4 | 46 | 70.5 | |
| mT-Ko-CImode=zero-shot, protocol=cross-lingual generalization2024.06 | 69 | 79.8 | 58.2 | 91 | 54.6 | 70.5 | |
| mT-Komode=zero-shot, protocol=cross-lingual generalization2024.06 | 59.1 | 65.3 | 57.2 | 74.6 | 44.2 | 60.1 | |
| mT5mode=zero-shot, protocol=cross-lingual generalization2024.06 | 36.6 | 57.2 | 52.4 | 49.2 | 27.3 | 44.5 |