Multiple Choice Question Answering on Part Multiple Choice
36.68AccuracyMeta-LLaMA3.1-8B
Evaluation results
| Method | Links | |
|---|---|---|
| Meta-LLaMA3.1-8B#Params (B)=8.032025.12 | 36.68 | |
| PartAI Dorna2-8B#Params (B)=8.032025.12 | 35.52 | |
| Gemma-2-2b-it#Params (B)=2.612025.12 | 31.12 | |
| Persian-Phi#Params (B)=3.852025.12 | 30.56 | |
| PersianMind-v1.0#Params (B)=6.822025.12 | 29.27 | |
| Phi-3-mini-4k-instruct#Params (B)=3.822025.12 | 27.37 | |
| Maral-7B-alpha-1#Params (B)=7.242025.12 | 26.67 |