Knowledge & Reasoning on CMMLU
63.4AccuracyEngram-40B
Evaluation Results
| Method | Links | |
|---|---|---|
| Engram-40BShots=5-shot2026.01 | 63.4 | |
| Engram-27BShots=5-shot2026.01 | 61.9 | |
| MoE-27BShots=5-shot2026.01 | 57.9 | |
| Dense-4BShots=5-shot2026.01 | 47.9 |
Loading the SOTA2 catalog…
| Method | Links | |
|---|---|---|
| Engram-40BShots=5-shot2026.01 | 63.4 | |
| Engram-27BShots=5-shot2026.01 | 61.9 | |
| MoE-27BShots=5-shot2026.01 | 57.9 | |
| Dense-4BShots=5-shot2026.01 | 47.9 |