Question Answering on XQuAD seen languages XTREME (test)
74.7F1 ScoreWordOT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| WordOTzero-shot transfer=true, averaged across=3 runs2021.10 | 74.7 | 59 | |
| mBERTzero-shot transfer=true, internal benchmarking=true, averaged across=3 runs2021.10 | 73.4 | 57.8 | |
| mBERTzero-shot transfer=true, averaged across=3 runs2021.10 | 73.1 | 57 | |
| MAD-XmBERTzero-shot transfer=true, internal benchmarking=true, averaged across=3 runs, backbone=mBERT2021.10 | 70.2 | 53.8 | |
| L2zero-shot transfer=true, internal benchmarking=true, averaged across=3 runs2021.10 | 68 | 51.6 | |
| XLMzero-shot transfer=true, averaged across=3 runs2021.10 | 66.5 | 50.2 |