Scene Completion on X-CODAH
69.9Score (EN)MCP(XLM-R-L)
Evaluation results
| Method | Links | |||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| MCP(XLM-R-L)transfer_setting=zero-shot cross-lingual, training_dataset=English-only, backbone=XLM-R-Large2021.06 | 69.9 | 60.7 | 61.9 | 60.7 | 61.4 | 60.7 | 58.6 | 62.3 | 61.9 | 53.7 | 59 | 54.1 | 54.7 | 60.8 | 44.6 | 48 | 58.3 | |
| XLM-R-Ltransfer_setting=zero-shot cross-lingual, training_dataset=English-only, model_size=Large2021.06 | 66.4 | 59.6 | 59.9 | 60.9 | 60.1 | 59.3 | 56.3 | 57.4 | 57.3 | 49.1 | 57.5 | 51.2 | 53.8 | 58.2 | 42.2 | 46.6 | 56 | |
| MCP(XLM-R-B)transfer_setting=zero-shot cross-lingual, training_dataset=English-only, backbone=XLM-R-Base2021.06 | 52.2 | 47.6 | 46.2 | 44.4 | 48.1 | 44.8 | 42.9 | 43.2 | 45.7 | 37.8 | 41.8 | 41.8 | 42.9 | 44.7 | 37.2 | 36.4 | 43.6 | |
| XLM-R-Btransfer_setting=zero-shot cross-lingual, training_dataset=English-only, model_size=Base2021.06 | 50.1 | 45.8 | 44.4 | 44.2 | 45.2 | 42 | 44.1 | 43.2 | 44.6 | 38.1 | 41.9 | 37.8 | 42 | 44.1 | 35.6 | 34.6 | 42.4 | |
| mBERTtransfer_setting=zero-shot cross-lingual, training_dataset=English-only2021.06 | 42.9 | 33.1 | 33.5 | 33.8 | 35.2 | 33.7 | 31.9 | 22.8 | 38 | 26.5 | 31 | 34.8 | 34 | 37.2 | 30.8 | 31.5 | 33.2 | |
| XLM-100transfer_setting=zero-shot cross-lingual, training_dataset=English-only2021.06 | 42.7 | 31.5 | 32.2 | 30.7 | 34.9 | 32.6 | 30.9 | 24.7 | 31.4 | 26.8 | 27 | 30 | 27.4 | 33.2 | 25.3 | 24.9 | 30.4 |