List your company
ResearchFormerly WizWand

Multiple Choice Question Answering on MC Benchmarks

74.7MC AvgBaseline
43.18851.36959.5567.731Oct 15, 2025
Updated 7mo ago

Evaluation results

MethodLinks
BaselineModel=GLM-4.5-Air, Compression=Baseline2025.1074.7
BaselineModel=Qwen3-30B-A3B, Compression=Baseline2025.1072.1
HC-SMoEModel=GLM-4.5-Air, Compression=25%, Technique=Merging2025.1070.4
HC-SMoEModel=Qwen3-30B-A3B, Compression=25%, Technique=Merging2025.1067.4
REAPModel=GLM-4.5-Air, Compression=25%, Technique=Pruning2025.1067.4
REAPModel=Qwen3-30B-A3B, Compression=25%, Technique=Pruning2025.1066.5
FrequencyModel=GLM-4.5-Air, Compression=25%, Technique=Pruning2025.1064.8
EANModel=GLM-4.5-Air, Compression=25%, Technique=Pruning2025.1063.7
EANModel=Qwen3-30B-A3B, Compression=25%, Technique=Pruning2025.1060.3
FrequencyModel=Qwen3-30B-A3B, Compression=25%, Technique=Pruning2025.1060
M-SMoEModel=GLM-4.5-Air, Compression=25%, Technique=Merging2025.1059.6
HC-SMoEModel=GLM-4.5-Air, Compression=50%, Technique=Merging2025.1056.4
M-SMoEModel=Qwen3-30B-A3B, Compression=25%, Technique=Merging2025.1055.8
REAPModel=GLM-4.5-Air, Compression=50%, Technique=Pruning2025.1055.4
HC-SMoEModel=Qwen3-30B-A3B, Compression=50%, Technique=Merging2025.1054.2
FrequencyModel=GLM-4.5-Air, Compression=50%, Technique=Pruning2025.1052.1
EANModel=GLM-4.5-Air, Compression=50%, Technique=Pruning2025.1051.1
REAPModel=Qwen3-30B-A3B, Compression=50%, Technique=Pruning2025.1050.3
EANModel=Qwen3-30B-A3B, Compression=50%, Technique=Pruning2025.1049.3
FrequencyModel=Qwen3-30B-A3B, Compression=50%, Technique=Pruning2025.1048.3
M-SMoEModel=Qwen3-30B-A3B, Compression=50%, Technique=Merging2025.1045.1
M-SMoEModel=GLM-4.5-Air, Compression=50%, Technique=Merging2025.1044.4