Language Understanding on MMLU-Pro (Accuracy, TPS, Speedup)
0.678Overall ScoreAIMMerging
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| AIMMergingSize=14B2026.05 | 0.678 | — | — | — | |
| FOREVERSize=14B2026.05 | 0.665 | — | — | — | |
| EWCSize=14B2026.05 | 0.653 | — | — | — | |
| AIMMergingSize=8B2026.05 | 0.629 | — | — | — | |
| EWCSize=8B2026.05 | 0.604 | — | — | — | |
| Seq. SFTSize=14B2026.05 | 0.604 | — | — | — | |
| FOREVERSize=8B2026.05 | 0.596 | — | — | — | |
| AIMMergingSize=4B2026.05 | 0.581 | — | — | — | |
| EWCSize=4B2026.05 | 0.554 | — | — | — | |
| Seq. SFTSize=8B2026.05 | 0.549 | — | — | — | |
| FOREVERSize=4B2026.05 | 0.547 | — | — | — | |
| Seq. SFTSize=4B2026.05 | 0.516 | — | — | — | |
| AIMMergingSize=1.7B2026.05 | 0.418 | — | — | — | |
| EWCSize=1.7B2026.05 | 0.4 | — | — | — | |
| FOREVERSize=1.7B2026.05 | 0.385 | — | — | — | |
| Seq. SFTSize=1.7B2026.05 | 0.37 | — | — | — | |
| AIMMergingSize=0.6B2026.05 | 0.271 | — | — | — | |
| EWCSize=0.6B2026.05 | 0.248 | — | — | — | |
| FOREVERSize=0.6B2026.05 | 0.247 | — | — | — | |
| Seq. SFTSize=0.6B2026.05 | 0.244 | — | — | — | |
| GLM-4.7-FP8Mode=Standalone2026.05 | — | 72 | 70 | — | |
| PARSETarget Model=GLM-4.7-FP8, Draft Model=Qwen3.5-9B2026.05 | — | 71.2 | 78.2 | 1.12 | |
| Qwen3.5-9BMode=Standalone2026.05 | — | 63.6 | — | — |