List your company
ResearchFormerly WizWand

Coding on Eval+ (test)

87.1ScoreFull
-3.48420.03343.5567.067Jun 14, 2026
Updated 4mo ago

Evaluation results

MethodLinks
FullModel=Qwen3, Pruning Ratio=0%, Criterion=Full, Calibration=C42026.0687.1
MANModel=Qwen3, Pruning Ratio=25%, Criterion=MAN, (b, α, β)=(1, 0, 1), Calibration=C42026.0686.8
FullModel=ERNIE, Pruning Ratio=0%, Criterion=Full, Calibration=C42026.0686.7
MSANModel=Qwen3, Pruning Ratio=25%, Criterion=MSAN, (b, α, β)=(1, 0, 2), Calibration=C42026.0684.7
REAPModel=Qwen3, Pruning Ratio=25%, Criterion=REAP, (b, α, β)=(1, 1, 1), Calibration=C42026.0659.9
FullModel=DeepSeek, Pruning Ratio=0%, Criterion=Full, Calibration=C42026.0654.9
MSANModel=ERNIE, Pruning Ratio=25%, Criterion=MSAN, (b, α, β)=(1, 0, 2), Calibration=C42026.0635.4
MANModel=ERNIE, Pruning Ratio=25%, Criterion=MAN, (b, α, β)=(1, 0, 1), Calibration=C42026.0634.3
FullModel=OLMoE, Pruning Ratio=0%, Criterion=Full, Calibration=C42026.0634.1
EANModel=ERNIE, Pruning Ratio=25%, Criterion=EAN, (b, α, β)=(0, 0, 1), Calibration=C42026.0630
REAPModel=ERNIE, Pruning Ratio=25%, Criterion=REAP, (b, α, β)=(1, 1, 1), Calibration=C42026.0627.7
SEERModel=ERNIE, Pruning Ratio=25%, Criterion=SEER, (b, α, β)=(0, 1, 0), Calibration=C42026.0625.6
FrequencyModel=ERNIE, Pruning Ratio=25%, Criterion=Frequency, (b, α, β)=(0, 0, 0), Calibration=C42026.0625.4
MoNEModel=ERNIE, Pruning Ratio=25%, Criterion=MoNE, Calibration=C42026.0621.7
MSANModel=DeepSeek, Pruning Ratio=25%, Criterion=MSAN, (b, α, β)=(1, 0, 2), Calibration=C42026.062.5
MANModel=OLMoE, Pruning Ratio=25%, Criterion=MAN, (b, α, β)=(1, 0, 1), Calibration=C42026.060.9
MSANModel=OLMoE, Pruning Ratio=25%, Criterion=MSAN, (b, α, β)=(1, 0, 2), Calibration=C42026.060.8
REAPModel=DeepSeek, Pruning Ratio=25%, Criterion=REAP, (b, α, β)=(1, 1, 1), Calibration=C42026.060.7
SEERModel=Qwen3, Pruning Ratio=25%, Criterion=SEER, (b, α, β)=(0, 1, 0), Calibration=C42026.060.3
MANModel=DeepSeek, Pruning Ratio=25%, Criterion=MAN, (b, α, β)=(1, 0, 1), Calibration=C42026.060.1
EANModel=Qwen3, Pruning Ratio=25%, Criterion=EAN, (b, α, β)=(0, 0, 1), Calibration=C42026.060.1
FrequencyModel=OLMoE, Pruning Ratio=25%, Criterion=Frequency, (b, α, β)=(0, 0, 0), Calibration=C42026.060
SEERModel=OLMoE, Pruning Ratio=25%, Criterion=SEER, (b, α, β)=(0, 1, 0), Calibration=C42026.060
EANModel=OLMoE, Pruning Ratio=25%, Criterion=EAN, (b, α, β)=(0, 0, 1), Calibration=C42026.060
REAPModel=OLMoE, Pruning Ratio=25%, Criterion=REAP, (b, α, β)=(1, 1, 1), Calibration=C42026.060
MoNEModel=OLMoE, Pruning Ratio=25%, Criterion=MoNE, Calibration=C42026.060
FrequencyModel=DeepSeek, Pruning Ratio=25%, Criterion=Frequency, (b, α, β)=(0, 0, 0), Calibration=C42026.060
SEERModel=DeepSeek, Pruning Ratio=25%, Criterion=SEER, (b, α, β)=(0, 1, 0), Calibration=C42026.060
EANModel=DeepSeek, Pruning Ratio=25%, Criterion=EAN, (b, α, β)=(0, 0, 1), Calibration=C42026.060
MoNEModel=DeepSeek, Pruning Ratio=25%, Criterion=MoNE, Calibration=C42026.060
FrequencyModel=Qwen3, Pruning Ratio=25%, Criterion=Frequency, (b, α, β)=(0, 0, 0), Calibration=C42026.060
MoNEModel=Qwen3, Pruning Ratio=25%, Criterion=MoNE, Calibration=C42026.060