Question Answering on Telugu (TE)
89.8AccuracyGemma 3 12B
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Gemma 3 12BSetting=TinT2026.05 | 89.8 | 87.4 | |
| Gemma 3 12BSetting=Baseline2026.05 | 79.7 | 77.6 | |
| LLaMA 3.1 8BSetting=TinT2026.05 | 78.4 | 78.3 | |
| Qwen 2.5 14BSetting=TinT2026.05 | 75.6 | 75.7 | |
| Qwen 2.5 14BSetting=Baseline2026.05 | 56.5 | 58.9 | |
| LLaMA 3.1 8BSetting=Baseline2026.05 | 48.2 | 49 |