Machine Translation on Tunisian Arabic Eng→Aeb
6.27BLEUHermes-2-Pro
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Hermes-2-ProSetting=Direct (Best k)2026.03 | 6.27 | 24.32 | |
| Hermes-2-ProSetting=With Pivot (Best k), Strategy=pivot-based prompting2026.03 | 5.06 | 24.31 | |
| TowerInstructSetting=With Pivot (Best k), Strategy=pivot-based prompting2026.03 | 4.99 | 20.63 | |
| Hermes-2-ProSetting=Zero-shot (k=0)2026.03 | 4.62 | 24.32 | |
| TowerInstructSetting=Direct (Best k)2026.03 | 4.46 | 20.74 | |
| NLLB-200Model Type=Baseline2026.03 | 4.2 | 10.42 | |
| NLLB-200 distilledLanguage Pair=Eng-Aeb2026.03 | 4.2 | 10.42 | |
| TowerInstructSetting=Zero-shot (k=0)2026.03 | 4.19 | 17.62 |