Question Answering on TyDiQA GoldP (test)
87.7F1 ScoreByT5 Large
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ByT5 LargeNumber of Parameters=1.23B2021.06 | 87.7 | 79.2 | |
| CHARFORMERNumber of Parameters=1.23B, Pre-training Steps=~100K less than baselines2021.06 | 86.3 | 77.3 | |
| mT5 LargeNumber of Parameters=1.23B2021.06 | 85.3 | 75.3 | |
| X-STILTSProtocol=Cross-lingual zero-shot transfer2020.09 | 76 | 59.5 | |
| FILTERProtocol=Translate-train, Learning approach=Self-Teaching2020.09 | 68.3 | 50.9 | |
| FILTERProtocol=Translate-train2020.09 | 68.1 | 49.7 | |
| XLM-RProtocol=Translate-train, Learning approach=multi-task2020.09 | 66.5 | 47.7 | |
| XLM-RProtocol=Cross-lingual zero-shot transfer2020.09 | 65.1 | 45 | |
| mBERTProtocol=Translate-train, Learning approach=multi-task2020.09 | 64.2 | 49.3 | |
| mBERTProtocol=Cross-lingual zero-shot transfer2020.09 | 59.7 | 43.9 | |
| mBERTProtocol=Translate-train2020.09 | 55.1 | 42.1 | |
| XLMProtocol=Cross-lingual zero-shot transfer2020.09 | 43.6 | 29.1 |