Question Answering on ARC Bengali (test)
79ARC AccuracyTrinity Large (MoE)
Evaluation results
| Method | Links | |
|---|---|---|
| Trinity Large (MoE)Architecture=MoE, Protocol=Zero-shot2026.02 | 79 | |
| Qwen3 8BParameters=8B, Protocol=Zero-shot2026.02 | 76 | |
| Qwen3 4BParameters=4B, Protocol=Zero-shot2026.02 | 67 | |
| Sarvam1 2BParameters=2B, Protocol=Zero-shot2026.02 | 56 | |
| Datology 8BParameters=8B, Protocol=Zero-shot2026.02 | 48 | |
| Datology 3BParameters=3B, Protocol=Zero-shot2026.02 | 42 | |
| Llama-3.1 8BParameters=8B, Protocol=Zero-shot2026.02 | 42 | |
| Granite-4.0 MicroParameters=Micro, Protocol=Zero-shot2026.02 | 42 | |
| Llama-3.2 3BParameters=3B, Protocol=Zero-shot2026.02 | 33 | |
| SmolLM3 3BParameters=3B, Protocol=Zero-shot2026.02 | 28 | |
| Llama-3.2 1BParameters=1B, Protocol=Zero-shot2026.02 | 24 |