Code on CruxEval-i
36.2Exact MatchEngram-40B
Evaluation Results
| Method | Links | |
|---|---|---|
| Engram-40BShots=0-shot2026.01 | 36.2 | |
| Engram-27BShots=0-shot2026.01 | 32.2 | |
| MoE-27BShots=0-shot2026.01 | 30.7 | |
| Dense-4BShots=0-shot2026.01 | 27.6 |
Loading the SOTA2 catalog…
| Method | Links | |
|---|---|---|
| Engram-40BShots=0-shot2026.01 | 36.2 | |
| Engram-27BShots=0-shot2026.01 | 32.2 | |
| MoE-27BShots=0-shot2026.01 | 30.7 | |
| Dense-4BShots=0-shot2026.01 | 27.6 |