Cross-lingual phrase retrieval on WikiXPR (test)
91.9ar-en ScoreXPR
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| XPREvaluation setting=Multilingual supervised2022.04 | 91.9 | 82.76 | 90.79 | 85.16 | 90.16 | 88.22 | 93.09 | 86.47 | 88.57 | |
| XPREvaluation setting=Supervised2022.04 | 88.63 | 81.44 | 84.53 | 80.18 | 87.32 | 80.83 | 91 | 77.62 | 83.94 | |
| XPREvaluation setting=Zero-shot transfer2022.04 | 74.12 | 73.6 | 82.54 | 77.36 | 73.04 | 78.52 | 79.1 | 77.62 | 76.99 | |
| CLWEEvaluation setting=Supervised2022.04 | 56.14 | 33.62 | 63.71 | 51.26 | 31.62 | 50.14 | 38.67 | 30.02 | 44.4 | |
| CLSEEvaluation setting=Supervised2022.04 | 20.58 | 18.79 | 36.06 | 26.6 | 16.73 | 24.58 | 21.32 | 17.69 | 22.79 | |
| XPREvaluation setting=Unsupervised2022.04 | 14.71 | 28.96 | 42.25 | 39.38 | 7.34 | 15.22 | 24.24 | 11.26 | 22.92 | |
| CLWEEvaluation setting=Multilingual supervised2022.04 | 12.33 | 1.87 | 6.63 | 3.77 | 18.46 | 4 | 9.84 | 11.19 | 8.51 | |
| CLSEEvaluation setting=Multilingual supervised2022.04 | 11.98 | 19.64 | 29.44 | 21.58 | 11.91 | 14.73 | 18.01 | 14.5 | 17.72 | |
| CLSEEvaluation setting=Unsupervised2022.04 | 9.7 | 19.1 | 29.21 | 20.89 | 4.83 | 11.5 | 16.98 | 8.76 | 15.12 | |
| CLSEEvaluation setting=Zero-shot transfer2022.04 | 6.18 | 10.25 | 16.07 | 10.39 | 6.73 | 9.75 | 8.35 | 17.69 | 10.68 | |
| CLWEEvaluation setting=Unsupervised2022.04 | 2.74 | 0.78 | 0 | 1.02 | 0.34 | 0.28 | 1.32 | 0.12 | 0.83 | |
| CLWEEvaluation setting=Zero-shot transfer2022.04 | 0.04 | 0.32 | 0.22 | 0.23 | 0 | 2.24 | 0.09 | 30.02 | 4.15 |