Dialectal Arabic Evaluation on Belebele
86.81AccuracyFanar-27B
Evaluation results
| Method | Links | |
|---|---|---|
| Fanar-27BSize=27B, Shot count=3-shot2026.03 | 86.81 | |
| Jais-2-70B-ChatSize=70B, Shot count=3-shot2026.03 | 86.67 | |
| Qwen3-32BSize=32B, Shot count=3-shot2026.03 | 85.98 | |
| Gemma-3-27B-itSize=27B, Shot count=3-shot2026.03 | 85.54 | |
| KarnakSize=40B, Shot count=3-shot2026.03 | 85.25 | |
| AceGPT-v2-70B-ChatSize=70B, Shot count=3-shot2026.03 | 84.22 | |
| AceGPT-v2-32B-ChatSize=32B, Shot count=3-shot2026.03 | 83.96 | |
| Fanar-1-9b-instructSize=9B, Shot count=3-shot2026.03 | 83.26 | |
| Llama-3.3-70b-InstructSize=70B, Shot count=3-shot2026.03 | 82.85 | |
| Allam-7B-Instruct-preview-v2Size=7B, Shot count=3-shot2026.03 | 77.19 |