Bilingual Lexicon Induction on XLING (test)
61.8Average ScoreLLAMA-2 13B
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| LLAMA-2 13BMethod Class=SAIL (Ours)2024.02 | 61.8 | 57.69 | 67 | 64.11 | 63.18 | 57.04 | — | — | — | — | — | — | |
| LLAMA 13BMethod Class=SAIL (Ours)2024.02 | 59.69 | 55.35 | 64.84 | 62.49 | 61.27 | 54.5 | — | — | — | — | — | — | |
| SAILProtocol=SAIL, Backbone=LLaMA-2-13B2024.02 | 59.31 | — | — | — | — | — | 61.5 | 56.29 | 63.75 | 59.93 | 60.29 | 54.11 | |
| LLAMA-2 7BMethod Class=SAIL (Ours)2024.02 | 58.55 | 53.81 | 64.12 | 61.09 | 59.96 | 53.77 | — | — | — | — | — | — | |
| GPT-4Protocol=Zero-Shot, Backbone=GPT-42024.02 | 58.37 | — | — | — | — | — | 62.6 | 60.63 | 55.9 | 60.35 | 61.39 | 49.35 | |
| GPT-3.5Protocol=Zero-Shot, Backbone=GPT-3.52024.02 | 56.72 | — | — | — | — | — | 59.52 | 58.41 | 55.85 | 59.93 | 59.77 | 46.82 | |
| LLAMA 7BMethod Class=SAIL (Ours)2024.02 | 55.97 | 51.39 | 61.92 | 58.92 | 56.94 | 50.7 | — | — | — | — | — | — | |
| LLAMA-2 13BMethod Class=ZERO-SHOT2024.02 | 49.71 | 47.12 | 55.02 | 51.31 | 52.02 | 43.09 | — | — | — | — | — | — | |
| LLAMA 13BMethod Class=ZERO-SHOT2024.02 | 48.69 | 45.39 | 53.35 | 52.39 | 50.58 | 41.74 | — | — | — | — | — | — | |
| CONTRASTIVEBLI (C2)Method Class=MAPPING-BASED2024.02 | 48.57 | 46.02 | 53.32 | 53.26 | 52.99 | 37.26 | — | — | — | — | — | — | |
| LLAMA-2 7BMethod Class=ZERO-SHOT2024.02 | 47.66 | 43.91 | 52.7 | 50.68 | 48.23 | 42.8 | — | — | — | — | — | — | |
| CONTRASTIVEBLI (C1)Method Class=MAPPING-BASED2024.02 | 47.28 | 44.72 | 52.12 | 52.29 | 51.77 | 35.5 | — | — | — | — | — | — | |
| VECMAPMethod Class=MAPPING-BASED2024.02 | 46.55 | 44.14 | 51.7 | 51.51 | 51.03 | 34.36 | — | — | — | — | — | — | |
| LLaMA-2-13BProtocol=Zero-Shot, Backbone=LLaMA-2-13B2024.02 | 46.26 | — | — | — | — | — | 46.64 | 50.8 | 47.6 | 51.44 | 41.17 | 39.94 | |
| LLAMA 7BMethod Class=ZERO-SHOT2024.02 | 45.46 | 41.94 | 50.16 | 48.25 | 46.91 | 40.04 | — | — | — | — | — | — |