Islamic Inheritance Reasoning on MAWARITH 500-case (test)
97.1Sh (Heirs and Blocking)QU-NLP (Multi-Stage QLoRA)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| QU-NLP (Multi-Stage QLoRA)Post-processing=Basic, Prompting=Task-specific inference prompt2026.03 | 97.1 | 94.3 | 84.6 | 90 | |
| Gemini-2.5-flashSetting=Zero-shot, Role=Commercial reasoning model2026.03 | 94.5 | 92.9 | 89.4 | 90.1 | |
| GPT-OSS-120BSetting=Zero-shot, Prompting=Unified Arabic prompt2026.03 | 69.3 | 32.7 | 27.1 | 39.1 | |
| Qwen3-32BSetting=Zero-shot, Prompting=Unified Arabic prompt2026.03 | 69 | 44.6 | 26.5 | 43.7 | |
| LLaMA-3.3-70BSetting=Zero-shot, Prompting=Unified Arabic prompt2026.03 | 64.8 | 40.3 | 21.5 | 39 | |
| Fanar-SadiqSetting=Zero-shot, Prompting=Unified Arabic prompt, Type=Islamic-specialized variant2026.03 | 62.1 | 36.7 | 20.4 | 36.8 | |
| Fanar-C-2-27BSetting=Zero-shot, Prompting=Unified Arabic prompt, Type=General-purpose variant2026.03 | 58.4 | 31.4 | 17.8 | 32.8 |