Multiple Choice Question Answering on ARC Challenge Persian
0.604AccuracyMeta-LLaMA3.1-8B
Evaluation results
| Method | Links | |
|---|---|---|
| Meta-LLaMA3.1-8B#Params (B)=8.032025.12 | 0.604 | |
| Gemma-2-2b-it#Params (B)=2.612025.12 | 0.5772 | |
| PartAI Dorna2-8B#Params (B)=8.032025.12 | 0.5352 | |
| Persian-Phi#Params (B)=3.852025.12 | 0.51 | |
| PersianMind-v1.0#Params (B)=6.822025.12 | 0.4832 | |
| Phi-3-mini-4k-instruct#Params (B)=3.822025.12 | 0.3678 | |
| Maral-7B-alpha-1#Params (B)=7.242025.12 | 0.3288 |