Multi-task Performance Evaluation on GPQA-Diamond, GSM8K, MATH-500, AIME’24, and IFEval Aggregate
58.72Avg ScoreProFit
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ProFitModel=Qwen3-14B-Base2026.01 | 58.72 | 5.64 | |
| DFTModel=Qwen3-14B-Base2026.01 | 56.38 | 3.3 | |
| VanillaModel=Qwen3-14B-Base2026.01 | 53.08 | — | |
| ProFitModel=Qwen3-4B-Base2026.01 | 52.33 | 11.41 | |
| EntropyModel=Qwen3-14B-Base2026.01 | 51.8 | -1.28 | |
| SFTModel=Qwen3-14B-Base2026.01 | 51.2 | -1.88 | |
| DFTModel=Qwen3-4B-Base2026.01 | 50.3 | 9.38 | |
| SFTModel=Qwen3-4B-Base2026.01 | 41.39 | 0.47 | |
| VanillaModel=Qwen3-4B-Base2026.01 | 40.92 | — | |
| EntropyModel=Qwen3-4B-Base2026.01 | 39.57 | -1.35 | |
| ProFitModel=Qwen3-0.6B-Base2026.01 | 31.49 | 16.82 | |
| DFTModel=Qwen3-0.6B-Base2026.01 | 30.2 | 15.53 | |
| EntropyModel=Qwen3-0.6B-Base2026.01 | 28.86 | 14.19 | |
| ProFitModel=OLMo-2-7B2026.01 | 28.54 | 5.47 | |
| SFTModel=Qwen3-0.6B-Base2026.01 | 28.51 | 13.84 | |
| SFTModel=OLMo-2-7B2026.01 | 28.03 | 4.96 | |
| EntropyModel=OLMo-2-7B2026.01 | 27.82 | 4.75 | |
| DFTModel=OLMo-2-7B2026.01 | 27.1 | 4.03 | |
| ProFitModel=Llama-3.1-8B2026.01 | 27.04 | 9.97 | |
| EntropyModel=Llama-3.1-8B2026.01 | 26.98 | 9.91 | |
| SFTModel=Llama-3.1-8B2026.01 | 26.7 | 9.63 | |
| VanillaModel=OLMo-2-7B2026.01 | 23.07 | — | |
| DFTModel=Llama-3.1-8B2026.01 | 22.38 | 5.31 | |
| VanillaModel=Llama-3.1-8B2026.01 | 17.07 | — | |
| VanillaModel=Qwen3-0.6B-Base2026.01 | 14.67 | — |