English to Dialectal Arabic Translation on AMIYA Shared Task (MADAR) (test)
0.7ADI2 (Moroccan)Das Gollapalli et al.
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Das Gollapalli et al.Notes=Top submission for AMIYA shared task2026.04 | 0.7 | 0.63 | 0.12 | 0.1 | 0.07 | 4.6 | 5.5 | 5.8 | 6 | 7.4 | |
| Llama 3.1 + IDIOLEX SFTBase Model=Llama 3.1 8B, Training Strategy=IDIOLEX SFT2026.04 | 0.6 | 0.29 | 0.12 | 0.1 | 0.07 | 27 | 25.4 | 27.1 | 26.4 | 29.5 | |
| Llama 3.1 + SFTBase Model=Llama 3.1 8B, Training Strategy=Standard SFT2026.04 | 0.57 | 0.27 | 0.11 | 0.08 | 0.05 | 22 | 22.4 | 25.4 | 23.9 | 28.2 | |
| Gaber et al.Notes=Top submission for AMIYA shared task2026.04 | 0.57 | 0.45 | 0.1 | 0.18 | 0.1 | 29.2 | 39.5 | 38.4 | 33.2 | 42.9 | |
| Allam + IDIOLEX SFTBase Model=Allam 7B, Training Strategy=IDIOLEX SFT2026.04 | 0.54 | 0.48 | 0.14 | 0.12 | 0.11 | 33.2 | 36.4 | 36.1 | 34.6 | 36.7 | |
| Allam + SFTBase Model=Allam 7B, Training Strategy=Standard SFT2026.04 | 0.49 | 0.45 | 0.12 | 0.13 | 0.11 | 31.8 | 33.3 | 34.2 | 35.1 | 37.3 | |
| Mutal et al.Notes=Top submission for AMIYA shared task2026.04 | 0.38 | 0.15 | 0.07 | 0.22 | 0.05 | 34.5 | 31 | 38.3 | 17.7 | 38.2 | |
| AllamBase Model=Allam 7B, Training Strategy=Pre-trained Baseline2026.04 | 0.26 | 0.28 | 0.05 | 0.07 | 0.04 | 30.7 | 33.3 | 34.3 | 33.5 | 35.4 | |
| Llama 3.1Base Model=Llama 3.1 8B, Training Strategy=Pre-trained Baseline2026.04 | 0.09 | 0.12 | 0.02 | 0.02 | 0.01 | 21.1 | 20.2 | 23.9 | 21 | 29 |