Question Answering on Urdu Question Answering (QA-C) (Clean)
47ROUGE-LQwen 2.5
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen 2.5Parameters=1.5B, Shot-count=k=5, Averaging=5 runs2026.01 | 47 | |
| Qwen 2.5Parameters=3B, Shot-count=k=5, Averaging=5 runs2026.01 | 46 | |
| LLaMA 3.2Parameters=3B, Shot-count=k=5, Averaging=5 runs2026.01 | 42 | |
| Gemma 2Parameters=2B, Shot-count=k=5, Averaging=5 runs2026.01 | 36 | |
| LLaMA 3.2Parameters=1B, Shot-count=k=5, Averaging=5 runs2026.01 | 35 | |
| UrduLMParameters=100M, Shot-count=k=5, Averaging=5 runs2026.01 | 17 |