Mathematical Reasoning on Gaokao (pass@1 evaluation)
72.7Average ScoreSAI-DPO
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SAI-DPOModel=Qwen3-8B2025.05 | 72.7 | — | — | |
| IDPOModel=Qwen3-8B2025.05 | 71 | — | — | |
| Base ModelModel=Qwen3-8B2025.05 | 68.1 | — | — | |
| SAI-DPOModel=Qwen2.5-7B-Math-SFT2025.05 | 67.5 | — | — | |
| IDPOModel=Qwen2.5-7B-Math-SFT2025.05 | 65.7 | — | — | |
| Base ModelModel=Qwen2.5-7B-Math-SFT2025.05 | 65.5 | — | — | |
| SAI-DPOModel=Qwen2.5-7B-Math-Base2025.05 | 62.3 | — | — | |
| IDPOModel=Qwen2.5-7B-Math-Base2025.05 | 61.5 | — | — | |
| Base ModelModel=Qwen2.5-7B-Math-Base2025.05 | 56.1 | — | — | |
| Scaf-GRPOCategory=Long CoT2025.10 | 50.9 | 63.4 | — | |
| LUFFYCategory=Long CoT2025.10 | 46.6 | 62.7 | — | |
| Oat-ZeroCategory=Long CoT2025.10 | 46.5 | 62.9 | — | |
| OpenReasoner-ZeroCategory=Long CoT2025.10 | 45 | 67.2 | — | |
| Eurus-2-7B-PRIMECategory=Long CoT2025.10 | 43.6 | 59.3 | — | |
| rStar-Math-7BCategory=Long CoT2025.10 | 43.6 | 59.2 | — | |
| SimpleRL-ZeroCategory=Long CoT2025.10 | 42.6 | 60.8 | — | |
| SAI-DPOModel=Llama3.1-8B-Instruct2025.05 | 35.7 | — | — | |
| IDPOModel=Llama3.1-8B-Instruct2025.05 | 34.5 | — | — | |
| Base ModelModel=Llama3.1-8B-Instruct2025.05 | 31.9 | — | — | |
| Qwen-2.5-7B-BaseCategory=Short CoT2025.10 | 31.3 | 42.6 | — | |
| Qwen-2.5-Math-7B-BaseCategory=Short CoT2025.10 | 27.5 | 35.1 | — | |
| BaselineBackbone=DeepSeek-R1-Distill-Qwen-7B2025.05 | — | — | 80.22 | |
| BaselineBackbone=DeepSeek-R1-Distill-Llama-8B2025.05 | — | — | 72.78 | |
| BaselineBackbone=Qwen2.5-14B-Instruct2025.05 | — | — | 41.14 | |
| BaselineBackbone=Qwen2.5-32B-Instruct2025.05 | — | — | 44.15 | |
| BaselineBackbone=QwQ-32B2025.05 | — | — | 86.88 | |
| GRPOBackbone=DeepSeek-R1-Distill-Qwen-7B2025.05 | — | — | 80.3 | |
| GRPOBackbone=DeepSeek-R1-Distill-Llama-8B2025.05 | — | — | 68.99 | |
| GRPOBackbone=Qwen2.5-14B-Instruct2025.05 | — | — | 39.16 | |
| GRPOBackbone=Qwen2.5-32B-Instruct2025.05 | — | — | 45.73 | |
| GRPOBackbone=QwQ-32B2025.05 | — | — | 87.11 | |
| SGPOBackbone=DeepSeek-R1-Distill-Qwen-7B, Judge Model=o4-mini-04162025.05 | — | — | 81.33 | |
| SGPOBackbone=DeepSeek-R1-Distill-Qwen-7B, Judge Model=DeepSeek-V3-03242025.05 | — | — | 82.28 | |
| SGPOBackbone=DeepSeek-R1-Distill-Qwen-7B, Judge Model=Qwen3-235B-A22B2025.05 | — | — | 81.17 | |
| SGPOBackbone=DeepSeek-R1-Distill-Qwen-7B, Judge Model=QwQ-32B2025.05 | — | — | 82.28 | |
| SGPOBackbone=DeepSeek-R1-Distill-Qwen-7B, Judge Model=QwQ-32B, Stability Parameters=w/o {beta,gamma}2025.05 | — | — | 81.24 | |
| SGPOBackbone=DeepSeek-R1-Distill-Llama-8B, Judge Model=Claude-3.72025.05 | — | — | 71.52 | |
| SGPOBackbone=Qwen2.5-14B-Instruct, Judge Model=o4-mini-04162025.05 | — | — | 39 | |
| SGPOBackbone=Qwen2.5-32B-Instruct, Judge Model=o4-mini-04162025.05 | — | — | 45.09 | |
| SGPOBackbone=QwQ-32B, Judge Model=DeepSeek-V3-03242025.05 | — | — | 87.11 |