List your company
ResearchFormerly WizWand

Multiple Choice Question Answering on HellaSwag (normalized accuracy)

78.2Normalized AccuracyOriginal
24.84838.69952.5566.401May 28, 2026
Updated 5mo ago

Evaluation results

MethodLinks
OriginalModel=OLMoE-1B-7B-0125, Reduction ratio=0%2026.0578.2
OriginalModel=Qwen3-30B-A3B, Reduction ratio=0%2026.0577.6
FrequencyModel=Qwen3-30B-A3B, Reduction ratio=25%2026.0577.6
M-SMoEModel=Qwen3-30B-A3B, Reduction ratio=25%2026.0577.5
ConMoEModel=Qwen3-30B-A3B, Reduction ratio=25%2026.0577.2
OriginalModel=deepseek-moe-16b-base, Reduction ratio=0%2026.0577.2
REAPModel=Qwen3-30B-A3B, Reduction ratio=25%2026.0576.8
REAPModel=deepseek-moe-16b-base, Reduction ratio=25%2026.0576.5
ConMoEModel=deepseek-moe-16b-base, Reduction ratio=25%2026.0575.7
FrequencyModel=Qwen3-30B-A3B, Reduction ratio=50%2026.0574.7
FrequencyModel=deepseek-moe-16b-base, Reduction ratio=25%2026.0574.7
REAPModel=OLMoE-1B-7B-0125, Reduction ratio=25%2026.0574.7
ConMoEModel=OLMoE-1B-7B-0125, Reduction ratio=25%2026.0574.1
HC-SMoEModel=deepseek-moe-16b-base, Reduction ratio=25%2026.0574
REAPModel=Qwen3-30B-A3B, Reduction ratio=50%2026.0573.6
M-SMoEModel=Qwen3-30B-A3B, Reduction ratio=50%2026.0573.5
ConMoEModel=Qwen3-30B-A3B, Reduction ratio=50%2026.0571.5
HC-SMoEModel=OLMoE-1B-7B-0125, Reduction ratio=25%2026.0571.2
REAPModel=deepseek-moe-16b-base, Reduction ratio=50%2026.0569.9
ConMoEModel=deepseek-moe-16b-base, Reduction ratio=50%2026.0569
M-SMoEModel=deepseek-moe-16b-base, Reduction ratio=25%2026.0568.2
FrequencyModel=deepseek-moe-16b-base, Reduction ratio=50%2026.0567.8
FrequencyModel=OLMoE-1B-7B-0125, Reduction ratio=25%2026.0566.8
HC-SMoEModel=Qwen3-30B-A3B, Reduction ratio=25%2026.0565.3
HC-SMoEModel=deepseek-moe-16b-base, Reduction ratio=50%2026.0562.9
M-SMoEModel=OLMoE-1B-7B-0125, Reduction ratio=25%2026.0562.7
REAPModel=OLMoE-1B-7B-0125, Reduction ratio=50%2026.0556.3
HC-SMoEModel=OLMoE-1B-7B-0125, Reduction ratio=50%2026.0552.8
ConMoEModel=OLMoE-1B-7B-0125, Reduction ratio=50%2026.0549.8
FrequencyModel=OLMoE-1B-7B-0125, Reduction ratio=50%2026.0549.4
HC-SMoEModel=Qwen3-30B-A3B, Reduction ratio=50%2026.0537
M-SMoEModel=OLMoE-1B-7B-0125, Reduction ratio=50%2026.0532.7
M-SMoEModel=deepseek-moe-16b-base, Reduction ratio=50%2026.0526.9