Question Answering on X-CSQA
69.5Accuracy (EN)MCP(XLM-R-L)
Evaluation results
| Method | Links | |||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| MCP(XLM-R-L)transfer_setting=zero-shot cross-lingual, training_dataset=English-only, backbone=XLM-R-Large2021.06 | 69.5 | 59.3 | 60.3 | 61.4 | 60 | 61.1 | 57.5 | 55.7 | 56.7 | 51.3 | 56.1 | 52.3 | 50.2 | 60.7 | 43.3 | 48.8 | 56.5 | |
| XLM-R-Ltransfer_setting=zero-shot cross-lingual, training_dataset=English-only, model_size=Large2021.06 | 66.7 | 56.1 | 58.2 | 59.5 | 60.3 | 56.8 | 52.1 | 51.4 | 52.7 | 48.7 | 53.9 | 48.4 | 50 | 59.9 | 41.6 | 45.2 | 53.8 | |
| MCP(XLM-R-B)transfer_setting=zero-shot cross-lingual, training_dataset=English-only, backbone=XLM-R-Base2021.06 | 52.1 | 46.2 | 45.6 | 44.3 | 44.7 | 45.3 | 42.8 | 45.3 | 44.3 | 36.8 | 41.4 | 36.8 | 37.5 | 44.9 | 28.1 | 33.4 | 41.9 | |
| XLM-R-Btransfer_setting=zero-shot cross-lingual, training_dataset=English-only, model_size=Base2021.06 | 51.5 | 44.1 | 42.1 | 44.8 | 44 | 43.3 | 39.5 | 42.6 | 40.6 | 34.6 | 40.2 | 38.4 | 37.5 | 43.4 | 29.6 | 33 | 40.6 | |
| mBERTtransfer_setting=zero-shot cross-lingual, training_dataset=English-only2021.06 | 38.8 | 29.6 | 36.4 | 35.3 | 33.8 | 32.6 | 32.7 | 22.2 | 37.8 | 21.1 | 27.2 | 27.7 | 31.4 | 34.1 | 21.8 | 23.7 | 30.4 | |
| XLM-100transfer_setting=zero-shot cross-lingual, training_dataset=English-only2021.06 | 34.3 | 26.7 | 28.5 | 29.3 | 28.3 | 27.2 | 29.9 | 21.1 | 28.6 | 22.1 | 26.6 | 26.3 | 25.1 | 30.9 | 20.1 | 21.7 | 26.7 |