Bilingual Lexicon Induction on Glavaš 5k translation pairs 2019
48.86Recall (DE->*)Stage C2 (C1)
Evaluation Results
| Method | Links | |||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Stage C2 (C1)Word similarity measure=CSLS, Base method for Stage C2=Stage C1, Pre-trained multilingual LM=mBERT2022.03 | 48.86 | 50.12 | 54.31 | 55.47 | 43.44 | 41.97 | 51.91 | 54.53 | 45.53 | 42.65 | 51.91 | 53.85 | 47.24 | 45.2 | 39.86 | 39.26 | 47.88 | |
| Stage C1Word similarity measure=CSLS2022.03 | 46.14 | 46.39 | 51.31 | 52.61 | 39.8 | 38.82 | 49.12 | 51.84 | 40.22 | 37.82 | 48.92 | 50.99 | 44.17 | 42.15 | 36.61 | 35.67 | 44.54 | |
| RCSLS+Word similarity measure=CSLS, Self-learning=false2022.03 | 43.77 | 44.74 | 50.94 | 49.17 | 35.11 | 33.49 | 47.02 | 49.42 | 34.06 | 32.8 | 46.59 | 48.41 | 40.99 | 40.1 | 31.29 | 31.66 | 41.22 | |
| FIPPWord similarity measure=CSLS, Self-learning=true2022.03 | 40.95 | 41.66 | 45.76 | 47.96 | 34.83 | 33 | 44.03 | 48.08 | 33.52 | 31.52 | 44.11 | 46.64 | 39.72 | 36.03 | 30.34 | 28.37 | 39.16 | |
| VecMapWord similarity measure=CSLS, Self-learning=false2022.03 | 40.49 | 42.18 | 45.43 | 50.19 | 36.29 | 33.4 | 44.67 | 48.86 | 36.26 | 32.96 | 44.77 | 47.85 | 41.01 | 35.62 | 31.54 | 29.42 | 40.06 | |
| LNMapWord similarity measure=CSLS, Self-learning=true2022.03 | 40.35 | 39.55 | 44.74 | 44.32 | 33.18 | 34.15 | 42.8 | 46.25 | 33.41 | 31.34 | 43.23 | 45.53 | 37.94 | 35.66 | 30.14 | 28.99 | 38.22 |