Question Answering on XQuAD v1.1 (test)
89F1 (en)mLUKE-W
Evaluation Results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| mLUKE-WScale=large, Input Features=words2021.10 | 89 | 83.1 | 82.4 | 81.3 | 81.3 | 75.3 | 77.9 | 81.2 | 75.1 | 71.5 | 77.3 | 79.6 | |
| mLUKE-EScale=large, Input Features=words+entities2021.10 | 88.6 | 83 | 81.7 | 81.4 | 80.8 | 75.8 | 77.7 | 81.9 | 75.4 | 71.9 | 77.5 | 79.6 | |
| XLM-RScale=large2021.10 | 88.5 | 82.4 | 82 | 81.4 | 81.2 | 75.5 | 75.9 | 80.7 | 72.3 | 67.6 | 77.2 | 78.6 | |
| mLUKE-EScale=base, Input Features=words+entities2021.10 | 86.3 | 78.9 | 78.9 | 73.9 | 76 | 68.8 | 71.4 | 76.4 | 67.5 | 65.9 | 72.2 | 74.2 | |
| XLM-RScale=base, Extra Training=true2021.10 | 86.1 | 76.9 | 76.5 | 73.7 | 74.7 | 66.3 | 68.2 | 74.5 | 67.7 | 64.7 | 66.6 | 72.4 | |
| mLUKE-WScale=base, Input Features=words2021.10 | 85.7 | 78 | 77.4 | 74.7 | 75.7 | 68.3 | 71.7 | 75.9 | 67.1 | 65.1 | 69.9 | 73.6 | |
| mBERTScale=base2021.10 | 84.5 | 76.1 | 73.1 | 59 | 70.2 | 53.2 | 62.1 | 68.5 | 40.7 | 58.3 | 57 | 63.9 | |
| XLM-RScale=base2021.10 | 84 | 76.5 | 76.4 | 73.9 | 74.4 | 67.8 | 68.1 | 74.2 | 66.8 | 61.5 | 68.7 | 72 |