Language Understanding on MMLU (Score and Speed)
73.89MMLU ScoreOPTIMER
Evaluation results
| Method | Links | ||
|---|---|---|---|
| OPTIMERBase Model=SEA-LION v42026.03 | 73.89 | — | |
| OPTIMERBase Model=Gemma 3 27B2026.03 | 73.44 | — | |
| Full DecodingModel=Dream-7B2026.02 | 68.2 | 1 | |
| Full DecodingModel=LLaDA-8B2026.02 | 67.3 | 1 | |
| JotModel=Dream-7B2026.02 | 66.7 | 1.54 | |
| JotModel=LLaDA-8B2026.02 | 64.5 | 1.61 | |
| KLASSModel=Dream-7B2026.02 | 64.4 | 1.08 | |
| SEA-LION v4 27B IT2026.03 | 63.84 | — | |
| KLASSModel=LLaDA-8B2026.02 | 63.4 | 1.24 | |
| ProphetModel=LLaDA-8B2026.02 | 63.3 | 2.04 | |
| ProphetModel=Dream-7B2026.02 | 60.2 | 1.38 | |
| Gemma 3 27B IT2026.03 | 51.03 | — |