Machine Translation on EN-X Translation (test)
85.45German Translation ScoreALMA-7B
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| ALMA-7BCategory=Prior LLM-based MT Models2024.10 | 85.45 | 89.05 | 87.05 | 84.87 | 86.61 | |
| Vanilla-FTBackbone=Mistral-7B-Instruct-v0.22024.10 | 83.04 | 84.33 | 86.23 | 83.63 | 84.31 | |
| RaDisBackbone=Mistral-7B-Instruct-v0.22024.10 | 82.95 | 84.32 | 86.55 | 83.75 | 84.39 | |
| Vanilla-FTBackbone=LLAMA-2-7B-Chat2024.10 | 82.81 | 81.8 | 84.67 | 81.96 | 82.81 | |
| RaDisBackbone=LLAMA-2-7B-Chat2024.10 | 82.39 | 81.77 | 84.31 | 81.98 | 82.61 | |
| BayLing-7BCategory=Prior LLM-based MT Models2024.10 | 82.18 | 76.85 | 74.72 | 84.43 | 79.55 | |
| ParroTCategory=Prior LLM-based MT Models2024.10 | 81.2 | — | — | 79.3 | — | |
| BigTransCategory=Prior LLM-based MT Models2024.10 | 78.81 | 80.65 | 78.21 | 81.31 | 79.75 | |
| SDFTBackbone=LLAMA-2-7B-Chat2024.10 | 75.21 | 68.59 | 79.67 | 78.45 | 75.48 | |
| Llama-2-7B-ChatBackbone=LLAMA-2-7B-Chat, Fine-tuning=Zero-shot2024.10 | 75.1 | 70.14 | 75.76 | 72.57 | 73.39 | |
| Seq-KDBackbone=LLAMA-2-7B-Chat2024.10 | 74.4 | 70.17 | 75.62 | 72.93 | 73.28 | |
| Seq-KDBackbone=Mistral-7B-Instruct-v0.22024.10 | 73.69 | 74.3 | 73.1 | 78.28 | 74.84 | |
| Mistral-7B-Instruct-v0.2Backbone=Mistral-7B-Instruct-v0.2, Fine-tuning=Zero-shot2024.10 | 67.87 | 67.39 | 64.56 | 71.32 | 67.79 | |
| SDFTBackbone=Mistral-7B-Instruct-v0.22024.10 | 53.32 | 51.9 | 47.07 | 56.38 | 52.17 |