Language Understanding and Reasoning on MMLU Pro
67.8Overall ScoreAIMMerging
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| AIMMergingSize=14B2026.05 | 67.8 | 67.2 | -0.007 | 72.3 | |
| FOREVERSize=14B2026.05 | 66.5 | 65.7 | -0.022 | 74.3 | |
| EWCSize=14B2026.05 | 65.3 | 64.4 | -0.028 | 71.7 | |
| AIMMergingSize=8B2026.05 | 62.9 | 61.9 | -0.011 | 67.9 | |
| EWCSize=8B2026.05 | 60.4 | 59.6 | -0.028 | 68.2 | |
| Seq. SFTSize=14B2026.05 | 60.4 | 59.9 | -0.045 | 72.6 | |
| FOREVERSize=8B2026.05 | 59.6 | 58.9 | -0.033 | 68.5 | |
| AIMMergingSize=4B2026.05 | 58.1 | 56.9 | -0.006 | 62.7 | |
| EWCSize=4B2026.05 | 55.4 | 54.6 | -0.11 | 62.9 | |
| Seq. SFTSize=8B2026.05 | 54.9 | 54.3 | -0.054 | 67.2 | |
| FOREVERSize=4B2026.05 | 54.7 | 53.4 | -0.034 | 63.5 | |
| Seq. SFTSize=4B2026.05 | 51.6 | 50.7 | -0.035 | 63 | |
| AIMMergingSize=1.7B2026.05 | 41.8 | 40.8 | -0.009 | 47.5 | |
| EWCSize=1.7B2026.05 | 40 | 38.6 | -0.031 | 46.6 | |
| FOREVERSize=1.7B2026.05 | 38.5 | 37.5 | -0.036 | 47.4 | |
| Seq. SFTSize=1.7B2026.05 | 37 | 36 | -0.029 | 47.4 | |
| AIMMergingSize=0.6B2026.05 | 27.1 | 26 | -0.011 | 35.1 | |
| EWCSize=0.6B2026.05 | 24.8 | 24 | -0.023 | 28.4 | |
| FOREVERSize=0.6B2026.05 | 24.7 | 23.8 | -0.023 | 29.6 | |
| Seq. SFTSize=0.6B2026.05 | 24.4 | 23.4 | -0.016 | 34.3 |