Language Understanding on MMLU Indonesian 1.0 (test)
76AccuracyTrinity Large (MoE)
Evaluation results
| Method | Links | |
|---|---|---|
| Trinity Large (MoE)Evaluation Setting=Zero-shot2026.02 | 76 | |
| Qwen3 8BEvaluation Setting=Zero-shot2026.02 | 68 | |
| Qwen3 4BEvaluation Setting=Zero-shot2026.02 | 64 | |
| Datology 8BEvaluation Setting=Zero-shot2026.02 | 52 | |
| Llama-3.1 8BEvaluation Setting=Zero-shot2026.02 | 49 | |
| Granite-4.0 MicroEvaluation Setting=Zero-shot2026.02 | 49 | |
| Datology 3BEvaluation Setting=Zero-shot2026.02 | 42 | |
| Llama-3.2 3BEvaluation Setting=Zero-shot2026.02 | 42 | |
| SmolLM3 3BEvaluation Setting=Zero-shot2026.02 | 42 | |
| Llama-3.2 1BEvaluation Setting=Zero-shot2026.02 | 31 | |
| LFM2.5 1.2BEvaluation Setting=Zero-shot2026.02 | 29 |