Dialectal Arabic Translation on Arabic Dialects Aggregate Task 2 OSACT 2024 (test)
47.82Diglossia ChrF++GPT-OSS-120B
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GPT-OSS-120BDecoding Configuration=Best (temp/top-p)2026.02 | 47.82 | 0.237 | |
| Command R ArabicDecoding Configuration=Best (temp/top-p)2026.02 | 46.6 | 0.053 | |
| Aladdin-FTIBackbone=Llama-3.1-8B-Instruct, Training Objective=Machine Translation + Instruction (Primary), Decoding Configuration=Best (temp/top-p)2026.02 | 35.09 | 0.233 | |
| Aladdin-FTIBackbone=SmolLM3-3B, Training Objective=Machine Translation + Instruction (Constrastive), Decoding Configuration=Best (temp/top-p)2026.02 | 33.65 | 0.067 | |
| Llama-3.1-8B-InstructDecoding Configuration=Best (temp/top-p)2026.02 | 32.99 | 0.065 | |
| SmolLM3-3BDecoding Configuration=Best (temp/top-p)2026.02 | 22.23 | 0.003 |