Math Reasoning on AIME 2025 (Full Pass@k Evaluation)
11.7Pass@1THR
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| THRBase Model=Qwen2.5-Math-7B, p=< 02025.10 | 11.7 | 17.9 | 24.9 | 32.1 | 38.9 | 44.7 | 50.7 | 57.9 | 66.7 | — | |
| GRPOBase Model=Qwen2.5-Math-7B2025.10 | 10.5 | 16.4 | 23.2 | 30.2 | 37.4 | 43.9 | 49.7 | 55.6 | 63.3 | — | |
| THRBase Model=Qwen2.5-Math-7B2025.10 | 9.6 | 15.2 | 21.9 | 29.2 | 36.2 | 42.6 | 49.8 | 58.3 | 63.3 | — | |
| THRBase Model=Qwen2.5-Math-7B, p=> 02025.10 | 9.3 | 15.2 | 22.4 | 29.9 | 36.5 | 42.4 | 48.5 | 55.9 | 63.3 | — | |
| ConfidenceModel=WeDLM-8B2026.04 | 7.4 | — | — | — | — | — | — | — | — | 29.2 | |
| IMHModel=WeDLM-8B2026.04 | 7.4 | — | — | — | — | — | — | — | — | 34.4 | |
| EntropyModel=WeDLM-8B, Default decoding=true2026.04 | 7.1 | — | — | — | — | — | — | — | — | 29.1 | |
| THRBase Model=Qwen2.5-Math-1.5B, p=< 02025.10 | 6 | 10.1 | 15.3 | 20.9 | 26.8 | 33.9 | 41.7 | 50 | 60 | — | |
| GRPOBase Model=Qwen2.5-Math-1.5B2025.10 | 5.9 | 9.9 | 15 | 20.5 | 26.5 | 33.6 | 41.5 | 49.8 | 56.7 | — | |
| THRBase Model=Qwen2.5-Math-1.5B2025.10 | 5.4 | 9.2 | 14.1 | 19.4 | 25 | 31.7 | 39.5 | 48 | 56.7 | — | |
| THRBase Model=Qwen2.5-Math-1.5B, p=> 02025.10 | 4.6 | 8 | 12.8 | 18.7 | 25.6 | 33.7 | 43 | 52.5 | 60 | — | |
| MarginModel=WeDLM-8B2026.04 | 3.1 | — | — | — | — | — | — | — | — | 26.9 | |
| BaseBase Model=Qwen2.5-Math-7B2025.10 | 2.7 | 5 | 8.9 | 14.7 | 21.7 | 29.5 | 37.4 | 44.5 | 50 | — | |
| BaseBase Model=Qwen2.5-Math-1.5B2025.10 | 1.3 | 2.6 | 4.9 | 8.6 | 13.9 | 19.9 | 26.2 | 33.4 | 40 | — | |
| GRPOBase Model=Qwen2.5-0.5B-Instruct2025.10 | 0.2 | 0.4 | 0.6 | 1.2 | 2.5 | 4.8 | 9.2 | 17.1 | 30 | — | |
| THRBase Model=Qwen2.5-0.5B-Instruct2025.10 | 0.2 | 0.3 | 0.6 | 1.2 | 2.5 | 4.8 | 9.2 | 17.1 | 30 | — | |
| THRBase Model=Qwen2.5-0.5B-Instruct, p=< 02025.10 | 0.2 | 0.3 | 0.6 | 1.1 | 2.3 | 4.6 | 9 | 17.5 | 33.3 | — | |
| BaseBase Model=Qwen2.5-0.5B-Instruct2025.10 | 0.1 | 0.2 | 0.3 | 0.6 | 1.2 | 2.5 | 5 | 10 | 20 | — | |
| THRBase Model=Qwen2.5-0.5B-Instruct, p=> 02025.10 | 0.1 | 0.3 | 0.5 | 0.9 | 1.9 | 3.7 | 7.3 | 14.2 | 26.7 | — |