General Knowledge on CMMLU
89.5AccuracyQwen3.5-35B-A3B
Evaluation Results
| Method | Links | |
|---|---|---|
| Qwen3.5-35B-A3B#Token=6002026.04 | 89.5 | |
| Qwen3-Next-80B-A3B#Token=5002026.04 | 89.1 | |
| GLM 4.6Evaluation Mode=Chat2025.12 | 88.4 | |
| LongCat-Flash Exp-ChatEvaluation Mode=Chat2025.12 | 87.5 | |
| DeepSeek V3.2Evaluation Mode=Chat2025.12 | 87.3 | |
| Qwen3-30B-A3B#Token=5002026.04 | 87.1 | |
| JoyAI-LLM Flash#Token=4002026.04 | 86.7 | |
| Qwen3-Next-80B-A3B-Instruct2026.03 | 86.5 | |
| Qwen3.5-35B-A3B-BaseEvaluation Framework=OpenCompass, Decoding=Greedy2026.04 | 86.1 | |
| Qwen3-Omni-A3B-Instruct2026.03 | 85.76 | |
| Qwen3-14B-BaseBackbone=Qwen3-14B-Base, CPT Strategy=None2025.12 | 84.92 | |
| LPS-CPTBackbone=Qwen3-14B-Base, CPT Strategy=Low-PPL Sampling2025.12 | 84.79 | |
| DOS-CPTBackbone=Qwen3-14B-Base, CPT Strategy=Distance-to-Optimum Selection2025.12 | 84.78 | |
| HPS-CPTBackbone=Qwen3-14B-Base, CPT Strategy=High-PPL Sampling2025.12 | 84.53 | |
| RS-CPTBackbone=Qwen3-14B-Base, CPT Strategy=Random Data Sampling2025.12 | 84.5 | |
| LongCat-Flash ChatEvaluation Mode=Chat2025.12 | 84.3 | |
| Qwen3-30B-A3BSparsity Level=Base, K=82026.05 | 83.69 | |
| Qwen3-30B-A3B-BaseEvaluation Framework=OpenCompass, Decoding=Greedy2026.04 | 83.6 | |
| JoyAI-LLM Flash-BaseEvaluation Framework=OpenCompass, Decoding=Greedy2026.04 | 83.1 | |
| LongCat-Next2026.03 | 82.13 | |
| BEAMSparsity Level=Mid Sparsity, beta=0.012026.05 | 81.53 | |
| GLM-4.7-Flash-T#Token=49002026.04 | 80.2 | |
| MoE-DynamicSparsity Level=Mid Sparsity, phi=0.32026.05 | 78.93 | |
| Top-K ReducedSparsity Level=Mid Sparsity, K=42026.05 | 78.27 | |
| Top-K PruningSparsity Level=Mid Sparsity, K=42026.05 | 76.27 | |
| Kimi-Linear-48B-A3B2026.03 | 76.26 | |
| Full AttentionSetting=CPT setting2026.04 | 75 | |
| BEAMSparsity Level=High Sparsity, beta=0.12026.05 | 74.54 | |
| Hybrid-SWASetting=CPT setting2026.04 | 73.69 | |
| KSASetting=CPT setting2026.04 | 73.29 | |
| Top-K ReducedSparsity Level=High Sparsity, K=22026.05 | 72.99 | |
| Hybrid-KSASetting=CPT setting2026.04 | 72.63 | |
| Hybrid-SCASetting=CPT setting2026.04 | 72.59 | |
| BEAMSparsity Level=Extreme Sparsity, beta=1.02026.05 | 69.36 | |
| Hybrid-LinearSetting=CPT setting2026.04 | 68.41 | |
| MoE-DynamicSparsity Level=High Sparsity, phi=0.12026.05 | 63.67 | |
| AdaMoESparsity Level=Mid Sparsity, Null=1282026.05 | 63.39 | |
| HY-1.8B-FP16Model Scale=1.8B, Precision=FP16, Instruction-tuned=true2026.02 | 55.07 | |
| Top-K ReducedSparsity Level=Extreme Sparsity, K=12026.05 | 53.05 | |
| HY-1.8B-INT4Model Scale=1.8B, Precision=INT4, Instruction-tuned=true2026.02 | 50.8 | |
| HY-1.8B-2BitModel Scale=1.8B, Precision=2Bit, Instruction-tuned=true2026.02 | 49.32 | |
| Hybrid-GDNsetting=Train-from-scratch2026.04 | 47.19 | |
| Hybrid-KSAsetting=Train-from-scratch2026.04 | 46.88 | |
| Hybrid-SCAsetting=Train-from-scratch2026.04 | 46.42 | |
| Hybrid-SWAsetting=Train-from-scratch2026.04 | 45.89 | |
| KSAsetting=Train-from-scratch2026.04 | 45.59 | |
| Fullsetting=Train-from-scratch2026.04 | 44.41 | |
| AdaMoESparsity Level=High Sparsity, Null=2562026.05 | 37.76 | |
| HY-0.5B-FP16Model Scale=0.5B, Precision=FP16, Instruction-tuned=true2026.02 | 37.08 | |
| Top-K PruningSparsity Level=High Sparsity, K=22026.05 | 16.42 |