Coding on LiveCode (test)
36.8ScoreFull
Evaluation Results
| Method | Links | |
|---|---|---|
| FullModel=Qwen3, Pruning Ratio=0%, Criterion=Full, Calibration=C42026.06 | 36.8 | |
| MANModel=Qwen3, Pruning Ratio=25%, Criterion=MAN, (b, α, β)=(1, 0, 1), Calibration=C42026.06 | 34.6 | |
| MSANModel=Qwen3, Pruning Ratio=25%, Criterion=MSAN, (b, α, β)=(1, 0, 2), Calibration=C42026.06 | 33.5 | |
| FullModel=ERNIE, Pruning Ratio=0%, Criterion=Full, Calibration=C42026.06 | 24.7 | |
| REAPModel=Qwen3, Pruning Ratio=25%, Criterion=REAP, (b, α, β)=(1, 1, 1), Calibration=C42026.06 | 13.7 | |
| FullModel=DeepSeek, Pruning Ratio=0%, Criterion=Full, Calibration=C42026.06 | 10.4 | |
| MANModel=ERNIE, Pruning Ratio=25%, Criterion=MAN, (b, α, β)=(1, 0, 1), Calibration=C42026.06 | 7.7 | |
| MSANModel=ERNIE, Pruning Ratio=25%, Criterion=MSAN, (b, α, β)=(1, 0, 2), Calibration=C42026.06 | 6.6 | |
| SEERModel=ERNIE, Pruning Ratio=25%, Criterion=SEER, (b, α, β)=(0, 1, 0), Calibration=C42026.06 | 6 | |
| REAPModel=ERNIE, Pruning Ratio=25%, Criterion=REAP, (b, α, β)=(1, 1, 1), Calibration=C42026.06 | 6 | |
| FrequencyModel=ERNIE, Pruning Ratio=25%, Criterion=Frequency, (b, α, β)=(0, 0, 0), Calibration=C42026.06 | 5.5 | |
| EANModel=ERNIE, Pruning Ratio=25%, Criterion=EAN, (b, α, β)=(0, 0, 1), Calibration=C42026.06 | 5.5 | |
| MoNEModel=ERNIE, Pruning Ratio=25%, Criterion=MoNE, Calibration=C42026.06 | 5.5 | |
| FullModel=OLMoE, Pruning Ratio=0%, Criterion=Full, Calibration=C42026.06 | 3.3 | |
| FrequencyModel=OLMoE, Pruning Ratio=25%, Criterion=Frequency, (b, α, β)=(0, 0, 0), Calibration=C42026.06 | 0 | |
| SEERModel=OLMoE, Pruning Ratio=25%, Criterion=SEER, (b, α, β)=(0, 1, 0), Calibration=C42026.06 | 0 | |
| EANModel=OLMoE, Pruning Ratio=25%, Criterion=EAN, (b, α, β)=(0, 0, 1), Calibration=C42026.06 | 0 | |
| REAPModel=OLMoE, Pruning Ratio=25%, Criterion=REAP, (b, α, β)=(1, 1, 1), Calibration=C42026.06 | 0 | |
| MoNEModel=OLMoE, Pruning Ratio=25%, Criterion=MoNE, Calibration=C42026.06 | 0 | |
| MANModel=OLMoE, Pruning Ratio=25%, Criterion=MAN, (b, α, β)=(1, 0, 1), Calibration=C42026.06 | 0 | |
| MSANModel=OLMoE, Pruning Ratio=25%, Criterion=MSAN, (b, α, β)=(1, 0, 2), Calibration=C42026.06 | 0 | |
| FrequencyModel=DeepSeek, Pruning Ratio=25%, Criterion=Frequency, (b, α, β)=(0, 0, 0), Calibration=C42026.06 | 0 | |
| SEERModel=DeepSeek, Pruning Ratio=25%, Criterion=SEER, (b, α, β)=(0, 1, 0), Calibration=C42026.06 | 0 | |
| EANModel=DeepSeek, Pruning Ratio=25%, Criterion=EAN, (b, α, β)=(0, 0, 1), Calibration=C42026.06 | 0 | |
| REAPModel=DeepSeek, Pruning Ratio=25%, Criterion=REAP, (b, α, β)=(1, 1, 1), Calibration=C42026.06 | 0 | |
| MoNEModel=DeepSeek, Pruning Ratio=25%, Criterion=MoNE, Calibration=C42026.06 | 0 | |
| MANModel=DeepSeek, Pruning Ratio=25%, Criterion=MAN, (b, α, β)=(1, 0, 1), Calibration=C42026.06 | 0 | |
| MSANModel=DeepSeek, Pruning Ratio=25%, Criterion=MSAN, (b, α, β)=(1, 0, 2), Calibration=C42026.06 | 0 | |
| FrequencyModel=Qwen3, Pruning Ratio=25%, Criterion=Frequency, (b, α, β)=(0, 0, 0), Calibration=C42026.06 | 0 | |
| SEERModel=Qwen3, Pruning Ratio=25%, Criterion=SEER, (b, α, β)=(0, 1, 0), Calibration=C42026.06 | 0 | |
| EANModel=Qwen3, Pruning Ratio=25%, Criterion=EAN, (b, α, β)=(0, 0, 1), Calibration=C42026.06 | 0 | |
| MoNEModel=Qwen3, Pruning Ratio=25%, Criterion=MoNE, Calibration=C42026.06 | 0 |