Question Answering on Marathi (MR)
90.7Accuracy (ACC)Gemma 3 12B
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Gemma 3 12BSetting=TinT2026.05 | 90.7 | 89 | |
| Qwen 2.5 14BSetting=TinT2026.05 | 84.4 | 81.3 | |
| LLaMA 3.1 8BSetting=TinT2026.05 | 83 | 82 | |
| Gemma 3 12BSetting=Baseline2026.05 | 80.3 | 78.6 | |
| Qwen 2.5 14BSetting=Baseline2026.05 | 72.9 | 68.2 | |
| LLaMA 3.1 8BSetting=Baseline2026.05 | 55.9 | 52.9 |