Language Understanding on MMLU-Pro (Score)
81.4MMLU-Pro ScoreGLM-4.5-Air
Evaluation Results
| Method | Links | |
|---|---|---|
| GLM-4.5-AirNumber of Parameters=110B2026.01 | 81.4 | |
| Solar OpenNumber of Parameters=102B2026.01 | 80.4 | |
| gpt-oss-120bNumber of Parameters=117B, Optimization Level=high2026.01 | 80.4 | |
| gpt-oss-120bNumber of Parameters=117B, Optimization Level=medium2026.01 | 78.6 | |
| BaselinePrecision=BF162026.07 | 69 | |
| Trinity Large Baseshot=5-shot2026.02 | 66.02 | |
| AFM-k5984d3s (Ours)Optimization=QAD + Speculative Decoding + SWA2026.07 | 65.9 | |
| Uniform scheduleCompression Step=Step 12026.06 | 54.21 | |
| Linear scheduleCompression Step=Step 12026.06 | 49.05 | |
| Cosine scheduleCompression Step=Step 12026.06 | 46.39 | |
| Qwen2-7BParameters=7B2024.07 | 40 | |
| Llama-3-8BParameters=8B2024.07 | 35.4 | |
| Uniform scheduleCompression Step=Step 22026.06 | 33.94 | |
| Gemma-7BParameters=7B2024.07 | 33.7 | |
| Polynomial scheduleCompression Step=Step 12026.06 | 33.16 | |
| Mistral-7BParameters=7B2024.07 | 30.9 | |
| Qwen1.5-7BParameters=7B2024.07 | 29.9 | |
| Linear scheduleCompression Step=Step 22026.06 | 24.97 | |
| ARPipeline=Qwen3-0.6B2026.04 | 24.7 | |
| Exponential scheduleCompression Step=Step 12026.06 | 21.41 | |
| Cosine scheduleCompression Step=Step 22026.06 | 21.26 | |
| TIDE-CrossPipeline=Cross-Tokenizer2026.04 | 14.52 | |
| TIDE-SharedPipeline=Shared-Tokenizer2026.04 | 14.48 | |
| TIDE-SharedPipeline=Cross-Tokenizer2026.04 | 14.02 | |
| Uniform scheduleCompression Step=Step 32026.06 | 13.95 | |
| BD3LMPipeline=Qwen3-0.6B2026.04 | 13.8 | |
| Linear scheduleCompression Step=Step 32026.06 | 13.58 | |
| CALMPipeline=Cross-Tokenizer2026.04 | 13.47 | |
| Polynomial scheduleCompression Step=Step 22026.06 | 13.38 | |
| KLPipeline=Shared-Tokenizer2026.04 | 13.19 | |
| TIDE-CrossPipeline=Shared-Tokenizer2026.04 | 12.88 | |
| Cosine scheduleCompression Step=Step 32026.06 | 12.57 | |
| Exponential scheduleCompression Step=Step 22026.06 | 11.83 | |
| Polynomial scheduleCompression Step=Step 32026.06 | 11.04 | |
| Exponential scheduleCompression Step=Step 32026.06 | 10.52 | |
| Cosine scheduleCompression Step=Step 42026.06 | 10.06 | |
| Polynomial scheduleCompression Step=Step 42026.06 | 9.61 | |
| Polynomial scheduleCompression Step=Step 52026.06 | 9.23 | |
| Linear scheduleCompression Step=Step 42026.06 | 9.16 | |
| Exponential scheduleCompression Step=Step 42026.06 | 8.99 | |
| Exponential scheduleCompression Step=Step 52026.06 | 8.63 | |
| Uniform scheduleCompression Step=Step 42026.06 | 8.44 | |
| Linear scheduleCompression Step=Step 52026.06 | 5.92 | |
| Cosine scheduleCompression Step=Step 52026.06 | 2.27 |