Question Answering on Urdu Question Answering (Non-Clean)
0.17ROUGE-LLLaMA 3.2
Evaluation results
| Method | Links | |
|---|---|---|
| LLaMA 3.2Parameters=3B, Shot-count=k=5, Averaging=5 runs2026.01 | 0.17 | |
| UrduLMParameters=100M, Shot-count=k=5, Averaging=5 runs2026.01 | 0.16 | |
| LLaMA 3.2Parameters=1B, Shot-count=k=5, Averaging=5 runs2026.01 | 0.16 | |
| Qwen 2.5Parameters=3B, Shot-count=k=5, Averaging=5 runs2026.01 | 0.16 | |
| Gemma 2Parameters=2B, Shot-count=k=5, Averaging=5 runs2026.01 | 0.13 | |
| Qwen 2.5Parameters=1.5B, Shot-count=k=5, Averaging=5 runs2026.01 | 0.12 |