Document-Level Translation on AFRIDOC-MT health domain eng2xx
42.1Amharic ScoreAfriqueGemma-12B
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| AfriqueGemma-12Bprompting=3-shot, k=102026.01 | 42.1 | 64.2 | 78.1 | 47 | 69.8 | 60.2 | |
| AfriqueQwen-14Bprompting=3-shot, k=102026.01 | 42 | 62.8 | 75.7 | 47.4 | 68.2 | 59.2 | |
| AfriqueLlama-8Bprompting=3-shot, k=102026.01 | 41.4 | 62 | 74.4 | 46.3 | 68.1 | 58.5 | |
| Llama 3.1 8B SFT10training=fine-tuned on 4K documents, prompting=3-shot, k=102026.01 | 27.6 | 49.7 | 64.1 | 50.3 | 47 | 47.8 | |
| Llama 3.1 8Bprompting=3-shot, k=102026.01 | 10.3 | 19.5 | 28.7 | 16.7 | 14.2 | 17.9 |