Reasoning on Urdu Reasoning
88.59ScoreQalb
Evaluation results
| Method | Links | |
|---|---|---|
| QalbBackbone=LLaMA-3.1-8B-Instruct2026.01 | 88.59 | |
| Gemma-2-9b-itBackbone=Gemma-2, Parameters=9B, Version=Instruction-tuned2026.01 | 85 | |
| Alif-1.0-8B-Inst.Backbone=Alif-1.0, Parameters=8B, Version=Instruct2026.01 | 83.5 | |
| Mistral-Nemo-2407Backbone=Mistral-Nemo2026.01 | 79.5 | |
| Qwen2.5-7B-Inst.Backbone=Qwen2.5, Parameters=7B, Version=Instruct2026.01 | 72 | |
| LLaMA-3-8b-Inst.Backbone=LLaMA-3, Parameters=8B, Version=Instruct2026.01 | 45.6 |