Coding on LiveCode
41.2LiveCode ScoreREAP
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| REAPModel=GLM-4.5-Air, Compression=25%, Technique=Pruning2025.10 | 41.2 | 58.5 | |
| BaselineModel=GLM-4.5-Air, Compression=Baseline2025.10 | 37.4 | 58 | |
| EANModel=GLM-4.5-Air, Compression=25%, Technique=Pruning2025.10 | 37.4 | 57.1 | |
| FullModel=Qwen3, Pruning Ratio=0%2026.06 | 36.8 | — | |
| HC-SMoEModel=GLM-4.5-Air, Compression=25%, Technique=Merging2025.10 | 36.3 | 55 | |
| REAPModel=GLM-4.5-Air, Compression=50%, Technique=Pruning2025.10 | 35.2 | 51.5 | |
| MANModel=Qwen3, Pruning Ratio=50%2026.06 | 34.6 | — | |
| FrequencyModel=GLM-4.5-Air, Compression=25%, Technique=Pruning2025.10 | 34.1 | 55 | |
| M-SMoEModel=GLM-4.5-Air, Compression=25%, Technique=Merging2025.10 | 33 | 52.8 | |
| EANModel=Qwen3-30B-A3B, Compression=25%, Technique=Pruning2025.10 | 31.1 | 55.4 | |
| EANModel=Qwen3-30B-A3B, Compression=50%, Technique=Pruning2025.10 | 30.6 | 53 | |
| REAPModel=Qwen3-30B-A3B, Compression=25%, Technique=Pruning2025.10 | 30.4 | 55.1 | |
| BaselineModel=Qwen3-30B-A3B, Compression=Baseline2025.10 | 30.2 | 55.8 | |
| FrequencyModel=Qwen3-30B-A3B, Compression=25%, Technique=Pruning2025.10 | 30.2 | 55.3 | |
| REAPModel=Qwen3-30B-A3B, Compression=50%, Technique=Pruning2025.10 | 30.2 | 54.1 | |
| M-SMoEModel=Qwen3-30B-A3B, Compression=25%, Technique=Merging2025.10 | 29.3 | 53.7 | |
| HC-SMoEModel=Qwen3-30B-A3B, Compression=25%, Technique=Merging2025.10 | 25.8 | 50.5 | |
| EANModel=GLM-4.5-Air, Compression=50%, Technique=Pruning2025.10 | 25.3 | 48.7 | |
| FullModel=ERNIE, Pruning Ratio=0%2026.06 | 24.7 | — | |
| FrequencyModel=Qwen3-30B-A3B, Compression=50%, Technique=Pruning2025.10 | 23.6 | 45.2 | |
| HC-SMoEModel=GLM-4.5-Air, Compression=50%, Technique=Merging2025.10 | 22 | 41.9 | |
| MANModel=ERNIE, Pruning Ratio=50%2026.06 | 21.4 | — | |
| M-SMoEModel=Qwen3-30B-A3B, Compression=50%, Technique=Merging2025.10 | 20.5 | 39.7 | |
| HC-SMoEModel=Qwen3-30B-A3B, Compression=50%, Technique=Merging2025.10 | 18.5 | 36.4 | |
| FrequencyModel=GLM-4.5-Air, Compression=50%, Technique=Pruning2025.10 | 10.4 | 30.8 | |
| FullModel=DeepSeek, Pruning Ratio=0%2026.06 | 10.4 | — | |
| M-SMoEModel=GLM-4.5-Air, Compression=50%, Technique=Merging2025.10 | 9.9 | 28.4 | |
| REAPModel=DeepSeek, Pruning Ratio=25%2026.06 | 8.8 | — | |
| MANModel=DeepSeek, Pruning Ratio=25%2026.06 | 7.7 | — | |
| FullModel=OLMoE, Pruning Ratio=0%2026.06 | 3.3 | — | |
| MANModel=OLMoE, Pruning Ratio=25%2026.06 | 1.6 | — |