Massive Multitask Language Understanding on MMLU Pro Persian
24.1AccuracyPartAI Dorna2-8B
Evaluation results
| Method | Links | |
|---|---|---|
| PartAI Dorna2-8B#Params (B)=8.032025.12 | 24.1 | |
| Meta-LLaMA3.1-8B#Params (B)=8.032025.12 | 21 | |
| Phi-3-mini-4k-instruct#Params (B)=3.822025.12 | 17.89 | |
| Persian-Phi#Params (B)=3.852025.12 | 17.18 | |
| Gemma-2-2b-it#Params (B)=2.612025.12 | 16.23 | |
| Maral-7B-alpha-1#Params (B)=7.242025.12 | 15.99 | |
| PersianMind-v1.0#Params (B)=6.822025.12 | 15.51 |