Unsupervised Bilingual Lexicon Induction on PanLex-BLI 6 directions
45.4BG ScoreSAIL
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| SAILEvaluation Protocol=SAIL (Ours), Backbone Model=LLAMA-2, Model Size=13B2024.02 | 45.4 | 46.26 | 44.88 | 45.51 | |
| SAILEvaluation Protocol=SAIL (Ours), Backbone Model=LLAMA, Model Size=13B2024.02 | 41.71 | 42.76 | 42.07 | 42.18 | |
| SAILEvaluation Protocol=SAIL (Ours), Backbone Model=LLAMA-2, Model Size=7B2024.02 | 40.06 | 40.51 | 40.22 | 40.27 | |
| CONTRASTIVEBLI (C2)Evaluation Protocol=MAPPING-BASED2024.02 | 38.87 | 38.48 | 40.54 | 39.3 | |
| VECMAPEvaluation Protocol=MAPPING-BASED2024.02 | 37.22 | 36.27 | 36.89 | 36.8 | |
| SAILEvaluation Protocol=SAIL (Ours), Backbone Model=LLAMA, Model Size=7B2024.02 | 37.02 | 37.63 | 36.29 | 36.98 | |
| CONTRASTIVEBLI (C1)Evaluation Protocol=MAPPING-BASED2024.02 | 36.7 | 35.86 | 37.82 | 36.79 | |
| LLAMA-2Evaluation Protocol=ZERO-SHOT, Model Size=13B2024.02 | 29.08 | 32.38 | 30.53 | 30.66 | |
| LLAMA-2Evaluation Protocol=ZERO-SHOT, Model Size=7B2024.02 | 28.2 | 27.21 | 26.92 | 27.45 | |
| LLAMAEvaluation Protocol=ZERO-SHOT, Model Size=7B2024.02 | 27.9 | 28.87 | 27.18 | 27.98 | |
| LLAMAEvaluation Protocol=ZERO-SHOT, Model Size=13B2024.02 | 27.49 | 30.61 | 28.2 | 28.77 |