Coding on Eval+ (test)
87.1ScoreFull
Evaluation Results
| Method | Links | |
|---|---|---|
| FullModel=Qwen3, Pruning Ratio=0%, Criterion=Full, Calibration=C42026.06 | 87.1 | |
| MANModel=Qwen3, Pruning Ratio=25%, Criterion=MAN, (b, α, β)=(1, 0, 1), Calibration=C42026.06 | 86.8 | |
| FullModel=ERNIE, Pruning Ratio=0%, Criterion=Full, Calibration=C42026.06 | 86.7 | |
| MSANModel=Qwen3, Pruning Ratio=25%, Criterion=MSAN, (b, α, β)=(1, 0, 2), Calibration=C42026.06 | 84.7 | |
| REAPModel=Qwen3, Pruning Ratio=25%, Criterion=REAP, (b, α, β)=(1, 1, 1), Calibration=C42026.06 | 59.9 | |
| FullModel=DeepSeek, Pruning Ratio=0%, Criterion=Full, Calibration=C42026.06 | 54.9 | |
| MSANModel=ERNIE, Pruning Ratio=25%, Criterion=MSAN, (b, α, β)=(1, 0, 2), Calibration=C42026.06 | 35.4 | |
| MANModel=ERNIE, Pruning Ratio=25%, Criterion=MAN, (b, α, β)=(1, 0, 1), Calibration=C42026.06 | 34.3 | |
| FullModel=OLMoE, Pruning Ratio=0%, Criterion=Full, Calibration=C42026.06 | 34.1 | |
| EANModel=ERNIE, Pruning Ratio=25%, Criterion=EAN, (b, α, β)=(0, 0, 1), Calibration=C42026.06 | 30 | |
| REAPModel=ERNIE, Pruning Ratio=25%, Criterion=REAP, (b, α, β)=(1, 1, 1), Calibration=C42026.06 | 27.7 | |
| SEERModel=ERNIE, Pruning Ratio=25%, Criterion=SEER, (b, α, β)=(0, 1, 0), Calibration=C42026.06 | 25.6 | |
| FrequencyModel=ERNIE, Pruning Ratio=25%, Criterion=Frequency, (b, α, β)=(0, 0, 0), Calibration=C42026.06 | 25.4 | |
| MoNEModel=ERNIE, Pruning Ratio=25%, Criterion=MoNE, Calibration=C42026.06 | 21.7 | |
| MSANModel=DeepSeek, Pruning Ratio=25%, Criterion=MSAN, (b, α, β)=(1, 0, 2), Calibration=C42026.06 | 2.5 | |
| MANModel=OLMoE, Pruning Ratio=25%, Criterion=MAN, (b, α, β)=(1, 0, 1), Calibration=C42026.06 | 0.9 | |
| MSANModel=OLMoE, Pruning Ratio=25%, Criterion=MSAN, (b, α, β)=(1, 0, 2), Calibration=C42026.06 | 0.8 | |
| REAPModel=DeepSeek, Pruning Ratio=25%, Criterion=REAP, (b, α, β)=(1, 1, 1), Calibration=C42026.06 | 0.7 | |
| SEERModel=Qwen3, Pruning Ratio=25%, Criterion=SEER, (b, α, β)=(0, 1, 0), Calibration=C42026.06 | 0.3 | |
| MANModel=DeepSeek, Pruning Ratio=25%, Criterion=MAN, (b, α, β)=(1, 0, 1), Calibration=C42026.06 | 0.1 | |
| EANModel=Qwen3, Pruning Ratio=25%, Criterion=EAN, (b, α, β)=(0, 0, 1), Calibration=C42026.06 | 0.1 | |
| FrequencyModel=OLMoE, Pruning Ratio=25%, Criterion=Frequency, (b, α, β)=(0, 0, 0), Calibration=C42026.06 | 0 | |
| SEERModel=OLMoE, Pruning Ratio=25%, Criterion=SEER, (b, α, β)=(0, 1, 0), Calibration=C42026.06 | 0 | |
| EANModel=OLMoE, Pruning Ratio=25%, Criterion=EAN, (b, α, β)=(0, 0, 1), Calibration=C42026.06 | 0 | |
| REAPModel=OLMoE, Pruning Ratio=25%, Criterion=REAP, (b, α, β)=(1, 1, 1), Calibration=C42026.06 | 0 | |
| MoNEModel=OLMoE, Pruning Ratio=25%, Criterion=MoNE, Calibration=C42026.06 | 0 | |
| FrequencyModel=DeepSeek, Pruning Ratio=25%, Criterion=Frequency, (b, α, β)=(0, 0, 0), Calibration=C42026.06 | 0 | |
| SEERModel=DeepSeek, Pruning Ratio=25%, Criterion=SEER, (b, α, β)=(0, 1, 0), Calibration=C42026.06 | 0 | |
| EANModel=DeepSeek, Pruning Ratio=25%, Criterion=EAN, (b, α, β)=(0, 0, 1), Calibration=C42026.06 | 0 | |
| MoNEModel=DeepSeek, Pruning Ratio=25%, Criterion=MoNE, Calibration=C42026.06 | 0 | |
| FrequencyModel=Qwen3, Pruning Ratio=25%, Criterion=Frequency, (b, α, β)=(0, 0, 0), Calibration=C42026.06 | 0 | |
| MoNEModel=Qwen3, Pruning Ratio=25%, Criterion=MoNE, Calibration=C42026.06 | 0 |