Multitask Language Understanding on MMLU Hindi (Accuracy)
67AccuracyTrinity Large (MoE)
Evaluation results
| Method | Links | |
|---|---|---|
| Trinity Large (MoE)Protocol=Zero-shot, Architecture=MoE2026.02 | 67 | |
| Qwen3 8BProtocol=Zero-shot, Parameters=8B2026.02 | 52 | |
| Qwen3 4BProtocol=Zero-shot, Parameters=4B2026.02 | 48 | |
| Sarvam1 2BProtocol=Zero-shot, Parameters=2B2026.02 | 42 | |
| Datology 8BProtocol=Zero-shot, Parameters=8B2026.02 | 39 | |
| Llama-3.1 8BProtocol=Zero-shot, Parameters=8B2026.02 | 38 | |
| SmolLM3 3BProtocol=Zero-shot, Parameters=3B2026.02 | 37 | |
| Granite-4.0 MicroProtocol=Zero-shot, Size=Micro2026.02 | 36 | |
| Llama-3.2 3BProtocol=Zero-shot, Parameters=3B2026.02 | 34 | |
| Datology 3BProtocol=Zero-shot, Parameters=3B2026.02 | 32 | |
| Llama-3.2 1BProtocol=Zero-shot, Parameters=1B2026.02 | 26 | |
| LFM2.5 1.2BProtocol=Zero-shot, Parameters=1.2B2026.02 | 24 |