Bilingual Lexicon Induction on Glavaš 1k translation pairs 2019
46.61Acc (DE→*)Stage C2 (C1)
Evaluation results
| Method | Links | |||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Stage C2 (C1)Word similarity measure=CSLS, Base method for Stage C2=Stage C1, Pre-trained multilingual LM=mBERT2022.03 | 46.61 | 46.01 | 49.84 | 54.03 | 40.28 | 39.63 | 48.57 | 52.17 | 42.16 | 38.77 | 49.22 | 50.94 | 44.61 | 41.04 | 36.89 | 35.57 | 44.77 | |
| Stage C1Word similarity measure=CSLS2022.03 | 43.94 | 43.15 | 47.16 | 51.59 | 36.81 | 36.61 | 46.23 | 49.75 | 37.28 | 34 | 46.55 | 48.5 | 42.21 | 38.02 | 33.77 | 32.34 | 41.74 | |
| FIPPWord similarity measure=CSLS, Self-learning=true2022.03 | 37.7 | 39.47 | 42.26 | 46.68 | 32.11 | 29.88 | 41.08 | 46.26 | 30.93 | 28.15 | 42.2 | 45.17 | 38.24 | 31.28 | 27.05 | 24.68 | 36.45 | |
| LNMapWord similarity measure=CSLS, Self-learning=true2022.03 | 37.28 | 36.74 | 40.44 | 43.61 | 30 | 29.95 | 39.77 | 43.81 | 30.05 | 27.67 | 39.93 | 43.47 | 35.13 | 29.71 | 26.63 | 24.26 | 34.9 | |
| VecMapWord similarity measure=CSLS, Self-learning=true2022.03 | 36.69 | 38.63 | 38.63 | 48.39 | 33.08 | 27.4 | 38.65 | 46.61 | 33.22 | 28.15 | 39.45 | 45.49 | 37.75 | 26.16 | 26.97 | 23.63 | 35.56 | |
| RCSLS+Word similarity measure=CSLS, Self-learning=false2022.03 | 33.43 | 32.23 | 38.16 | 38.57 | 22.49 | 22.29 | 34.98 | 36.83 | 21.59 | 20.87 | 36.67 | 38.33 | 28.45 | 27.78 | 18.72 | 17.59 | 29.31 |