Question Answering on Hindi (HI)
91Accuracy (ACC)Gemma 3 12B
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Gemma 3 12BSetting=TinT2026.05 | 91 | 88.8 | |
| Qwen 2.5 14BSetting=TinT2026.05 | 85.9 | 81.1 | |
| LLaMA 3.1 8BSetting=TinT2026.05 | 84.3 | 80.6 | |
| Gemma 3 12BSetting=Baseline2026.05 | 79.6 | 77.9 | |
| Qwen 2.5 14BSetting=Baseline2026.05 | 69.5 | 67.1 | |
| LLaMA 3.1 8BSetting=Baseline2026.05 | 57.5 | 53.9 |