Multiple Choice Question Answering on AUT Multiple Choice Persian
54.24AccuracyMeta-LLaMA3.1-8B
Evaluation results
| Method | Links | |
|---|---|---|
| Meta-LLaMA3.1-8B#Params (B)=8.032025.12 | 54.24 | |
| PartAI Dorna2-8B#Params (B)=8.032025.12 | 53.45 | |
| Gemma-2-2b-it#Params (B)=2.612025.12 | 49.9 | |
| PersianMind-v1.0#Params (B)=6.822025.12 | 45.36 | |
| Persian-Phi#Params (B)=3.852025.12 | 43.98 | |
| Maral-7B-alpha-1#Params (B)=7.242025.12 | 36.09 | |
| Phi-3-mini-4k-instruct#Params (B)=3.822025.12 | 35.1 |