List your company
ResearchFormerly WizWand

Multiple Choice on Multiple Choice MC Avg (test)

73.7Average AccuracyFull
55.29260.07164.8569.629Jun 14, 2026
Updated 4mo ago

Evaluation results

MethodLinks
FullModel=Qwen3, Pruning Ratio=0%, Criterion=Full, Calibration=C42026.0673.7
EANModel=Qwen3, Pruning Ratio=25%, Criterion=EAN, (b, α, β)=(0, 0, 1), Calibration=C42026.0673.5
SEERModel=Qwen3, Pruning Ratio=25%, Criterion=SEER, (b, α, β)=(0, 1, 0), Calibration=C42026.0673.4
MoNEModel=Qwen3, Pruning Ratio=25%, Criterion=MoNE, Calibration=C42026.0673.3
FrequencyModel=Qwen3, Pruning Ratio=25%, Criterion=Frequency, (b, α, β)=(0, 0, 0), Calibration=C42026.0673.2
MANModel=Qwen3, Pruning Ratio=25%, Criterion=MAN, (b, α, β)=(1, 0, 1), Calibration=C42026.0672.7
MSANModel=Qwen3, Pruning Ratio=25%, Criterion=MSAN, (b, α, β)=(1, 0, 2), Calibration=C42026.0672.7
FullModel=ERNIE, Pruning Ratio=0%, Criterion=Full, Calibration=C42026.0672.1
REAPModel=Qwen3, Pruning Ratio=25%, Criterion=REAP, (b, α, β)=(1, 1, 1), Calibration=C42026.0672.1
MANModel=ERNIE, Pruning Ratio=25%, Criterion=MAN, (b, α, β)=(1, 0, 1), Calibration=C42026.0670.5
MSANModel=ERNIE, Pruning Ratio=25%, Criterion=MSAN, (b, α, β)=(1, 0, 2), Calibration=C42026.0670.4
REAPModel=ERNIE, Pruning Ratio=25%, Criterion=REAP, (b, α, β)=(1, 1, 1), Calibration=C42026.0670
EANModel=ERNIE, Pruning Ratio=25%, Criterion=EAN, (b, α, β)=(0, 0, 1), Calibration=C42026.0668.2
FullModel=DeepSeek, Pruning Ratio=0%, Criterion=Full, Calibration=C42026.0667.8
MoNEModel=ERNIE, Pruning Ratio=25%, Criterion=MoNE, Calibration=C42026.0667.8
SEERModel=ERNIE, Pruning Ratio=25%, Criterion=SEER, (b, α, β)=(0, 1, 0), Calibration=C42026.0665.8
FrequencyModel=ERNIE, Pruning Ratio=25%, Criterion=Frequency, (b, α, β)=(0, 0, 0), Calibration=C42026.0665.5
FullModel=OLMoE, Pruning Ratio=0%, Criterion=Full, Calibration=C42026.0665.3
MANModel=DeepSeek, Pruning Ratio=25%, Criterion=MAN, (b, α, β)=(1, 0, 1), Calibration=C42026.0663.6
MSANModel=DeepSeek, Pruning Ratio=25%, Criterion=MSAN, (b, α, β)=(1, 0, 2), Calibration=C42026.0663
MoNEModel=DeepSeek, Pruning Ratio=25%, Criterion=MoNE, Calibration=C42026.0662.9
EANModel=DeepSeek, Pruning Ratio=25%, Criterion=EAN, (b, α, β)=(0, 0, 1), Calibration=C42026.0662.1
REAPModel=DeepSeek, Pruning Ratio=25%, Criterion=REAP, (b, α, β)=(1, 1, 1), Calibration=C42026.0662
FrequencyModel=DeepSeek, Pruning Ratio=25%, Criterion=Frequency, (b, α, β)=(0, 0, 0), Calibration=C42026.0660.2
SEERModel=DeepSeek, Pruning Ratio=25%, Criterion=SEER, (b, α, β)=(0, 1, 0), Calibration=C42026.0660.2
REAPModel=OLMoE, Pruning Ratio=25%, Criterion=REAP, (b, α, β)=(1, 1, 1), Calibration=C42026.0660.1
MANModel=OLMoE, Pruning Ratio=25%, Criterion=MAN, (b, α, β)=(1, 0, 1), Calibration=C42026.0659.4
MSANModel=OLMoE, Pruning Ratio=25%, Criterion=MSAN, (b, α, β)=(1, 0, 2), Calibration=C42026.0658.9
MoNEModel=OLMoE, Pruning Ratio=25%, Criterion=MoNE, Calibration=C42026.0658.3
EANModel=OLMoE, Pruning Ratio=25%, Criterion=EAN, (b, α, β)=(0, 0, 1), Calibration=C42026.0658.2
SEERModel=OLMoE, Pruning Ratio=25%, Criterion=SEER, (b, α, β)=(0, 1, 0), Calibration=C42026.0656.4
FrequencyModel=OLMoE, Pruning Ratio=25%, Criterion=Frequency, (b, α, β)=(0, 0, 0), Calibration=C42026.0656