Language Understanding on Openbench Easy
57.6Comp. AccMoE-A1B-24B
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| MoE-A1B-24BTokens=559B2026.01 | 57.6 | 54.4 | 47.2 | 42.3 | 41.6 | 50 | |
| ConceptMoE-A1B-24BTokens=559B2026.01 | 57.4 | 56.8 | 50 | 42.4 | 41.5 | 50.9 | |
| ConceptMoE-A0.5B-12BTokens=243B2026.01 | 47.3 | 39.1 | 28.8 | 30.7 | 26.1 | 36.4 | |
| MoE-A0.5B-12BTokens=243B2026.01 | 46.2 | 37.6 | 27.8 | 30.7 | 26.2 | 35.6 |