Multiple Choice Question Answering on MC Benchmarks
74.7MC AvgBaseline
Evaluation Results
| Method | Links | |
|---|---|---|
| BaselineModel=GLM-4.5-Air, Compression=Baseline2025.10 | 74.7 | |
| BaselineModel=Qwen3-30B-A3B, Compression=Baseline2025.10 | 72.1 | |
| HC-SMoEModel=GLM-4.5-Air, Compression=25%, Technique=Merging2025.10 | 70.4 | |
| HC-SMoEModel=Qwen3-30B-A3B, Compression=25%, Technique=Merging2025.10 | 67.4 | |
| REAPModel=GLM-4.5-Air, Compression=25%, Technique=Pruning2025.10 | 67.4 | |
| REAPModel=Qwen3-30B-A3B, Compression=25%, Technique=Pruning2025.10 | 66.5 | |
| FrequencyModel=GLM-4.5-Air, Compression=25%, Technique=Pruning2025.10 | 64.8 | |
| EANModel=GLM-4.5-Air, Compression=25%, Technique=Pruning2025.10 | 63.7 | |
| EANModel=Qwen3-30B-A3B, Compression=25%, Technique=Pruning2025.10 | 60.3 | |
| FrequencyModel=Qwen3-30B-A3B, Compression=25%, Technique=Pruning2025.10 | 60 | |
| M-SMoEModel=GLM-4.5-Air, Compression=25%, Technique=Merging2025.10 | 59.6 | |
| HC-SMoEModel=GLM-4.5-Air, Compression=50%, Technique=Merging2025.10 | 56.4 | |
| M-SMoEModel=Qwen3-30B-A3B, Compression=25%, Technique=Merging2025.10 | 55.8 | |
| REAPModel=GLM-4.5-Air, Compression=50%, Technique=Pruning2025.10 | 55.4 | |
| HC-SMoEModel=Qwen3-30B-A3B, Compression=50%, Technique=Merging2025.10 | 54.2 | |
| FrequencyModel=GLM-4.5-Air, Compression=50%, Technique=Pruning2025.10 | 52.1 | |
| EANModel=GLM-4.5-Air, Compression=50%, Technique=Pruning2025.10 | 51.1 | |
| REAPModel=Qwen3-30B-A3B, Compression=50%, Technique=Pruning2025.10 | 50.3 | |
| EANModel=Qwen3-30B-A3B, Compression=50%, Technique=Pruning2025.10 | 49.3 | |
| FrequencyModel=Qwen3-30B-A3B, Compression=50%, Technique=Pruning2025.10 | 48.3 | |
| M-SMoEModel=Qwen3-30B-A3B, Compression=50%, Technique=Merging2025.10 | 45.1 | |
| M-SMoEModel=GLM-4.5-Air, Compression=50%, Technique=Merging2025.10 | 44.4 |