Multitask Language Understanding on MMLU Bengali (test)
62MMLU ScoreTrinity Large (MoE)
Evaluation results
| Method | Links | |
|---|---|---|
| Trinity Large (MoE)Architecture=MoE, Protocol=Zero-shot2026.02 | 62 | |
| Qwen3 8BParameters=8B, Protocol=Zero-shot2026.02 | 50 | |
| Qwen3 4BParameters=4B, Protocol=Zero-shot2026.02 | 45 | |
| Sarvam1 2BParameters=2B, Protocol=Zero-shot2026.02 | 41 | |
| Datology 8BParameters=8B, Protocol=Zero-shot2026.02 | 36 | |
| Llama-3.1 8BParameters=8B, Protocol=Zero-shot2026.02 | 36 | |
| Granite-4.0 MicroParameters=Micro, Protocol=Zero-shot2026.02 | 36 | |
| Datology 3BParameters=3B, Protocol=Zero-shot2026.02 | 32 | |
| Llama-3.2 3BParameters=3B, Protocol=Zero-shot2026.02 | 31 | |
| SmolLM3 3BParameters=3B, Protocol=Zero-shot2026.02 | 30 | |
| Llama-3.2-1bParameter Scale=1B, zero-shot=true2026.06 | 29 | |
| Llama-3.2 1BParameters=1B, Protocol=Zero-shot2026.02 | 25 | |
| titulm-llama-3.2-1b-v2.0Parameter Scale=1B, zero-shot=true2026.06 | 25 | |
| bangla-smollm-135mParameter Scale=135M, zero-shot=true2026.06 | 23.7 | |
| Gemma-3-270mParameter Scale=270M, zero-shot=true2026.06 | 23.4 |