Machine Translation on GlossLM mid-high-resource languages
28.71BLEU (Urdu)chain-gloss
Evaluation results
| Method | Links | |||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| chain-glossLLM=Llama-3 70B2024.10 | 28.71 | 8.34 | 10.74 | 42.88 | 15.41 | 27.92 | 5.26 | 19.75 | 45.86 | 19.81 | 27.11 | 62.33 | 37.29 | 50.22 | 19.51 | 37.2 | 41.46 | |
| gloss-shotLLM=Llama-3 70B2024.10 | 26.86 | 6.26 | 9.56 | 44.37 | 13.65 | 23.99 | 5.6 | 18.61 | 43.49 | 19.27 | 27.17 | 63.72 | 35.71 | 48.13 | 21.19 | 36.95 | 41.05 | |
| few-shotLLM=Llama-3 70B2024.10 | 26.19 | 7.68 | 10.62 | 44.14 | 13.74 | 24.94 | 5.35 | 18.95 | 43.36 | 19.76 | 27.55 | 63.88 | 35.94 | 48.59 | 21.28 | 37.19 | 41.03 | |
| zero-CoTLLM=Llama-3 70B2024.10 | 4.71 | 1.8 | 8.22 | 37.2 | 7.26 | 23.42 | 3.81 | 12.35 | 22.6 | 12.91 | 25.56 | 56.5 | 27.3 | 45.07 | 19.18 | 29.87 | 35.1 | |
| zero-shotLLM=Llama-3 70B2024.10 | 4 | 1.35 | 6.13 | 37.75 | 7.17 | 25.12 | 3.46 | 12.15 | 20.53 | 12.56 | 23.14 | 59.21 | 27.62 | 47.31 | 19.95 | 30.05 | 35.42 | |
| NLLB-2002024.10 | 0.2 | 0.2 | 0.5 | 26.2 | 0.4 | 2.4 | 1.4 | 4.47 | 9.1 | 9.3 | 11.3 | 47 | 14.4 | 17 | 11.5 | 17.09 | 24.25 |