Urdu Mathematical Reasoning on MGSM-Urdu 250-problem (test)
3.87CorrectnessRiazi-8B
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Riazi-8BEvaluation Protocol=LLM-as-a-Judge, Training=CPT followed by CoT instruction tuning2026.06 | 3.87 | 3.9 | 4.14 | 4.2 | 4.19 | 4.06 | |
| Llama-8BEvaluation Protocol=LLM-as-a-Judge2026.06 | 3.51 | 3.5 | 3.85 | 3.84 | 3.86 | 3.71 | |
| Alif-8BEvaluation Protocol=LLM-as-a-Judge2026.06 | 2.27 | 2.23 | 3.52 | 2.83 | 2.67 | 2.7 | |
| Qalb-8BEvaluation Protocol=LLM-as-a-Judge2026.06 | 2.27 | 2.29 | 3.15 | 2.72 | 2.67 | 2.62 |