Document-Level Translation on AFRIDOC-MT health domain xx2eng
72.8Amharic Translation ScoreAfriqueQwen-14B
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| AfriqueQwen-14Bprompting=3-shot, k=102026.01 | 72.8 | 68.3 | 79.7 | 70.8 | 76.1 | 73.5 | |
| AfriqueGemma-12Bprompting=3-shot, k=102026.01 | 72.7 | 67.7 | 80.5 | 68.8 | 76.6 | 73.3 | |
| Llama 3.1 8B SFT10training=fine-tuned on 4K documents, prompting=3-shot, k=102026.01 | 63.8 | 61.7 | 74.4 | 68.9 | 71.4 | 68 | |
| AfriqueLlama-8Bprompting=3-shot, k=102026.01 | 44.7 | 58.2 | 66.6 | 53.5 | 63.4 | 57.3 | |
| Llama 3.1 8Bprompting=3-shot, k=102026.01 | 20 | 53.9 | 71.2 | 30.7 | 37 | 42.6 |