Question Answering on XQuAD (test)
82.4F1 ScoreFILTER
Evaluation results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| FILTERProtocol=Translate-train, Learning approach=Self-Teaching2020.09 | 82.4 | 68 | — | — | — | — | — | — | — | — | — | — | — | — | |
| FILTERProtocol=Translate-train2020.09 | 82.3 | 67.8 | — | — | — | — | — | — | — | — | — | — | — | — | |
| XLM-RProtocol=Translate-train, Learning approach=multi-task2020.09 | 80.2 | 65.9 | — | — | — | — | — | — | — | — | — | — | — | — | |
| X-STILTSProtocol=Cross-lingual zero-shot transfer2020.09 | 78.7 | 63.3 | — | — | — | — | — | — | — | — | — | — | — | — | |
| XLM-RProtocol=Cross-lingual zero-shot transfer2020.09 | 76.6 | 60.8 | — | — | — | — | — | — | — | — | — | — | — | — | |
| mBERTProtocol=Translate-train, Learning approach=multi-task2020.09 | 72.4 | 58.3 | — | — | — | — | — | — | — | — | — | — | — | — | |
| mBERTProtocol=Translate-train2020.09 | 70 | 56 | — | — | — | — | — | — | — | — | — | — | — | — | |
| mBERTProtocol=Cross-lingual zero-shot transfer2020.09 | 64.5 | 49.4 | — | — | — | — | — | — | — | — | — | — | — | — | |
| XLMProtocol=Cross-lingual zero-shot transfer2020.09 | 59.8 | 44.3 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Forgetting PLMModel Type=Forgetting2023.07 | — | — | — | 38.7 | 60.9 | 59.9 | 64.6 | 33.3 | 56.5 | 41.4 | 52.9 | 43.7 | 49 | 38.4 | |
| mBERTbaseline=true2021.06 | — | — | 84.2 | 54.8 | 68.9 | 60.2 | 71.1 | 55.7 | 68.6 | 48.9 | 64 | 57.2 | 63.4 | — | |
| mBERT (Reference [1])Reference=[1]2021.06 | — | — | 83.5 | 61.5 | 70.6 | 62.6 | 75.5 | 59.2 | 71.3 | 55.4 | 69.5 | 58 | 66.7 | — | |
| Standard PLMModel Type=Standard2023.07 | — | — | — | 22.2 | 50.9 | 48.5 | 57.7 | 21.4 | 49.4 | 13 | 49.7 | 32.4 | 36.1 | 15.4 | |
| Syntax-augmented mBERTsyntax-augmented=true2021.06 | — | — | 84 | 55.5 | 71.4 | 61.3 | 72.8 | 54.6 | 68.4 | 49.8 | 67.6 | 56.1 | 64.2 | — |