Question Answering on Bengali (BN)
90Accuracy (ACC)Gemma 3 12B
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Gemma 3 12BSetting=TinT2026.05 | 90 | 88.9 | |
| Qwen 2.5 14BSetting=TinT2026.05 | 85.4 | 81.6 | |
| LLaMA 3.1 8BSetting=TinT2026.05 | 83.3 | 82.5 | |
| Gemma 3 12BSetting=Baseline2026.05 | 78.4 | 78.1 | |
| Qwen 2.5 14BSetting=Baseline2026.05 | 70.6 | 68.6 | |
| LLaMA 3.1 8BSetting=Baseline2026.05 | 60.4 | 56.6 |