Coding on Coding Suite EvalPlus & LiveCodeBench
86.7Eval+ ScoreERNIE
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ERNIESparsity=Full2026.03 | 86.7 | 24.7 | 55.7 | |
| ESAPModel=ERNIE, Sparsity=25%, Criterion=SEER2026.03 | 83.8 | 20.3 | 52 | |
| ESAPModel=ERNIE, Sparsity=25%, Criterion=REAP2026.03 | 83.3 | 20.9 | 52.1 | |
| ESAPModel=ERNIE, Sparsity=25%, Criterion=EAN2026.03 | 83.2 | 22.5 | 52.8 | |
| SEERModel=ERNIE, Sparsity=25%, Allocation=UNI2026.03 | 83 | 21.4 | 52.2 | |
| EANModel=ERNIE, Sparsity=25%, Allocation=UNI2026.03 | 82.7 | 21.4 | 52 | |
| REAPModel=ERNIE, Sparsity=25%, Allocation=UNI2026.03 | 82.3 | 23.1 | 52.7 | |
| FreqModel=ERNIE, Sparsity=25%, Allocation=UNI2026.03 | 81.8 | 18.1 | 49.9 | |
| ESAPModel=ERNIE, Sparsity=25%, Criterion=Freq2026.03 | 81.1 | 23.6 | 52.4 | |
| ESAPModel=ERNIE, Sparsity=50%, Criterion=REAP2026.03 | 73.7 | 18.7 | 46.2 | |
| REAPModel=ERNIE, Sparsity=50%, Allocation=UNI2026.03 | 73 | 19.2 | 46.1 | |
| ESAPModel=ERNIE, Sparsity=50%, Criterion=SEER2026.03 | 70.9 | 18.1 | 44.5 | |
| SEERModel=ERNIE, Sparsity=50%, Allocation=UNI2026.03 | 69.8 | 17 | 43.4 | |
| ESAPModel=ERNIE, Sparsity=50%, Criterion=EAN2026.03 | 65.9 | 14.3 | 40.1 | |
| FreqModel=ERNIE, Sparsity=50%, Allocation=UNI2026.03 | 64.7 | 14.3 | 39.5 | |
| ESAPModel=ERNIE, Sparsity=50%, Criterion=Freq2026.03 | 64.7 | 12.6 | 38.7 | |
| EANModel=ERNIE, Sparsity=50%, Allocation=UNI2026.03 | 63.6 | 14.8 | 39.2 | |
| ESAPModel=OLMoE, Sparsity=25%, Criterion=REAP2026.03 | 34.4 | 3.3 | 18.9 | |
| EANModel=OLMoE, Sparsity=25%, Allocation=UNI2026.03 | 34.3 | 2.2 | 18.3 | |
| ESAPModel=OLMoE, Sparsity=25%, Criterion=Freq2026.03 | 34.2 | 2.2 | 18.2 | |
| OLMoESparsity=Full2026.03 | 34.1 | 3.3 | 18.7 | |
| FreqModel=OLMoE, Sparsity=25%, Allocation=UNI2026.03 | 34.1 | 2.2 | 18.2 | |
| SEERModel=OLMoE, Sparsity=25%, Allocation=UNI2026.03 | 33.9 | 2.7 | 18.3 | |
| REAPModel=OLMoE, Sparsity=25%, Allocation=UNI2026.03 | 31.4 | 0.5 | 16 | |
| ESAPModel=OLMoE, Sparsity=25%, Criterion=EAN2026.03 | 31.2 | 2.7 | 17 | |
| ESAPModel=OLMoE, Sparsity=25%, Criterion=SEER2026.03 | 30.6 | 2.2 | 16.4 |