Cross-lingual sentence retrieval on Tatoeba Parallel 14 language pairs
80.6AccuracyInfoXLM
Evaluation results
| Method | Links | |||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| InfoXLM2023.06 | 80.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| InfoXLM2023.06 | 77.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| XLM-P+post-training=MLM + InfoNCE2023.06 | 77.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| XLM-E2023.06 | 74.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| XLM-P+post-training=MLM + InfoNCE2023.06 | 73.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| XLM-E2023.06 | 72.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| InfoXLM (w/o XLCO)variant=without XLCO2023.06 | 65.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| InfoXLM (w/o XLCO)variant=without XLCO2023.06 | 64.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| XLM-P2023.06 | 64 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| XLM-P2023.06 | 61.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| XLM-R2023.06 | 59.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| XLM-R2023.06 | 57.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| XLM-E (w/o TRTD)variant=without TRTD2023.06 | 55.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| XLM-E (w/o TRTD)variant=without TRTD2023.06 | 55.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| INFOXLMDirection=xx → en2020.07 | — | 59 | 78.6 | 86.3 | 93.9 | 62.1 | 79.4 | 87.1 | 83.8 | 88.2 | 39.5 | 84.9 | 83.3 | 73 | 89.6 | 77.8 | — | |
| INFOXLMDirection=en → xx2020.07 | — | 68.6 | 78.6 | 86.4 | 95.1 | 72.6 | 84 | 88.3 | 85.7 | 87.2 | 40.8 | 91.2 | 84.7 | 73.3 | 92 | 80.6 | — | |
| INFOXLM2021.06 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 80.6 | — | |
| INFOXLM2021.06 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 77.8 | |
| XLCODirection=xx → en2020.07 | — | 42.9 | 65.5 | 69.5 | 91.1 | 55.6 | 76.4 | 71.6 | 74.9 | 74.8 | 20.5 | 68.1 | 69.8 | 51.6 | 81.8 | 65.3 | — | |
| XLCODirection=en → xx2020.07 | — | 45.4 | 64 | 69.3 | 88.1 | 56.5 | 72.3 | 69.6 | 73.6 | 71.5 | 22.1 | 79.7 | 64.3 | 48.2 | 79.8 | 64.6 | — | |
| XLM-E2021.06 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 74.4 | — | |
| XLM-EAblation=w/o TRTD2021.06 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 55.8 | — | |
| XLM-E2021.06 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 72.3 | |
| XLM-EAblation=w/o TRTD2021.06 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 55.1 | |
| XLM-RDirection=xx → en2020.07 | — | 36.8 | 67.6 | 60.7 | 89.9 | 53.7 | 74.1 | 54.2 | 72.5 | 74 | 18.7 | 38.3 | 61.1 | 36.6 | 68.4 | 57.6 | — | |
| XLM-RDirection=en → xx2020.07 | — | 38.6 | 69.9 | 60.3 | 89.4 | 57.3 | 74.3 | 49.3 | 73 | 74.6 | 14.4 | 58.4 | 64 | 36.9 | 72.5 | 59.5 | — | |
| XLM-R2021.06 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 59.5 | — | |
| XLM-R2021.06 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 57.6 |