Code on CRUXEval-O (EM)
35.3Exact MatchEngram-40B
Evaluation results
| Method | Links | |
|---|---|---|
| Engram-40BShots=0-shot2026.01 | 35.3 | |
| Engram-27BShots=0-shot2026.01 | 35 | |
| MoE-27BShots=0-shot2026.01 | 34.1 | |
| Dense-4BShots=0-shot2026.01 | 28.7 |
| Method | Links | |
|---|---|---|
| Engram-40BShots=0-shot2026.01 | 35.3 | |
| Engram-27BShots=0-shot2026.01 | 35 | |
| MoE-27BShots=0-shot2026.01 | 34.1 | |
| Dense-4BShots=0-shot2026.01 | 28.7 |