Code Generation on Coding Eval+ LiveCode (test)
87.2Eval+ ScoreREAP
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| REAPSparsity=25%, Allocation Protocol=UNI, Model=Qwen32026.03 | 87.2 | 38.5 | 62.9 | |
| Qwen3Sparsity=Full, Model=Qwen32026.03 | 87.1 | 36.8 | 61.9 | |
| EANSparsity=25%, Allocation Protocol=UNI, Model=Qwen32026.03 | 87.1 | 36.3 | 61.7 | |
| FullModel=Qwen3, Ratio=0%, Zero-shot=true2026.03 | 87.1 | 36.8 | 61.9 | |
| REAPModel=Qwen3, Ratio=25%, Zero-shot=true2026.03 | 86.4 | 31.3 | 58.9 | |
| FreqSparsity=25%, Allocation Protocol=UNI, Model=Qwen32026.03 | 86.2 | 35.7 | 60.9 | |
| SEERSparsity=25%, Allocation Protocol=ESAP, Model=Qwen32026.03 | 86.1 | 38.5 | 62.3 | |
| FreqSparsity=25%, Allocation Protocol=ESAP, Model=Qwen32026.03 | 86 | 39.6 | 62.8 | |
| EANSparsity=25%, Allocation Protocol=ESAP, Model=Qwen32026.03 | 85.8 | 36.3 | 61.1 | |
| REAPSparsity=50%, Allocation Protocol=ESAP, Model=Qwen32026.03 | 85.5 | 33.5 | 59.5 | |
| SEERSparsity=25%, Allocation Protocol=UNI, Model=Qwen32026.03 | 85.1 | 36.3 | 60.7 | |
| EANSparsity=50%, Allocation Protocol=UNI, Model=Qwen32026.03 | 84.6 | 34.1 | 59.4 | |
| MagnitudeModel=Qwen3, Ratio=25%, Zero-shot=true2026.03 | 84.5 | 31.3 | 57.9 | |
| AIMERModel=Qwen3, Ratio=25%, Zero-shot=true2026.03 | 84.5 | 34.6 | 59.5 | |
| EANSparsity=50%, Allocation Protocol=ESAP, Model=Qwen32026.03 | 83.9 | 34.6 | 59.3 | |
| REAPSparsity=25%, Allocation Protocol=ESAP, Model=Qwen32026.03 | 83.5 | 32.4 | 58 | |
| REAPSparsity=50%, Allocation Protocol=UNI, Model=Qwen32026.03 | 82.8 | 34.1 | 58.5 | |
| RandomModel=Qwen3, Ratio=25%, Zero-shot=true2026.03 | 82.3 | 28.6 | 55.4 | |
| FreqSparsity=50%, Allocation Protocol=ESAP, Model=Qwen32026.03 | 78.1 | 27.5 | 52.8 | |
| SEERSparsity=50%, Allocation Protocol=ESAP, Model=Qwen32026.03 | 76.7 | 26.4 | 51.6 | |
| SEERSparsity=50%, Allocation Protocol=UNI, Model=Qwen32026.03 | 70 | 24.7 | 47.3 | |
| FreqSparsity=50%, Allocation Protocol=UNI, Model=Qwen32026.03 | 70 | 22.5 | 46.2 | |
| AIMERModel=Qwen3, Ratio=50%, Zero-shot=true2026.03 | 60.1 | 12.1 | 36.1 | |
| REAPModel=Qwen3, Ratio=50%, Zero-shot=true2026.03 | 5.4 | 3.8 | 4.6 | |
| RandomModel=Qwen3, Ratio=50%, Zero-shot=true2026.03 | 1 | 0.5 | 0.7 | |
| SEERModel=Qwen3, Ratio=25%, Zero-shot=true2026.03 | 0.3 | 0 | 0.2 | |
| FrequencyModel=Qwen3, Ratio=25%, Zero-shot=true2026.03 | 0 | 0 | 0 | |
| EANModel=Qwen3, Ratio=25%, Zero-shot=true2026.03 | 0 | 0 | 0 | |
| FrequencyModel=Qwen3, Ratio=50%, Zero-shot=true2026.03 | 0 | 0 | 0 | |
| SEERModel=Qwen3, Ratio=50%, Zero-shot=true2026.03 | 0 | 0 | 0 | |
| EANModel=Qwen3, Ratio=50%, Zero-shot=true2026.03 | 0 | 0 | 0 | |
| MagnitudeModel=Qwen3, Ratio=50%, Zero-shot=true2026.03 | 0 | 0 | 0 |