Reasoning on Overall AMC23, AIME24, MATH500, GPQA-D aggregate
79.1AccuracyETR
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ETRBackbone=Qwen3-8B, Decoding Strategy=greedy decoding (pass@1)2026.04 | 79.1 | 5,100 | 0.77 | |
| DEERBackbone=Qwen3-8B, Decoding Strategy=greedy decoding (pass@1)2026.04 | 77.6 | 7,200 | 0.43 | |
| PEARBackbone=Qwen3-4B, Decoding Strategy=greedy decoding (pass@1)2026.04 | 77.2 | 6,700 | 0.79 | |
| ETRBackbone=Qwen3-4B, Decoding Strategy=greedy decoding (pass@1)2026.04 | 77.1 | 4,400 | 1.03 | |
| O1-PrunerBackbone=Qwen3-8B, Decoding Strategy=greedy decoding (pass@1)2026.04 | 76.3 | 4,000 | 0.7 | |
| PEARBackbone=Qwen3-8B, Decoding Strategy=greedy decoding (pass@1)2026.04 | 74.6 | 7,600 | 0.18 | |
| LCPOBackbone=Qwen3-8B, Decoding Strategy=greedy decoding (pass@1)2026.04 | 74.5 | 5,400 | 0.43 | |
| OriginalBackbone=Qwen3-8B, Decoding Strategy=greedy decoding (pass@1)2026.04 | 74 | 8,900 | 0 | |
| DEERBackbone=Qwen3-4B, Decoding Strategy=greedy decoding (pass@1)2026.04 | 73.5 | 7,400 | 0.44 | |
| PEARBackbone=DeepSeek-R1-Distill-7B, Decoding Strategy=greedy decoding (pass@1)2026.04 | 69.8 | 5,100 | 1.41 | |
| LCPOBackbone=Qwen3-4B, Decoding Strategy=greedy decoding (pass@1)2026.04 | 69.6 | 5,600 | 0.36 | |
| OriginalBackbone=Qwen3-4B, Decoding Strategy=greedy decoding (pass@1)2026.04 | 69.5 | 8,700 | 0 | |
| ETRBackbone=DeepSeek-R1-Distill-7B, Decoding Strategy=greedy decoding (pass@1)2026.04 | 68 | 2,800 | 1.53 | |
| O1-PrunerBackbone=Qwen3-4B, Decoding Strategy=greedy decoding (pass@1)2026.04 | 68 | 3,600 | 0.54 | |
| O1-PrunerBackbone=DeepSeek-R1-Distill-7B, Decoding Strategy=greedy decoding (pass@1)2026.04 | 66.9 | 4,800 | 1.18 | |
| DEERBackbone=DeepSeek-R1-Distill-7B, Decoding Strategy=greedy decoding (pass@1)2026.04 | 60.9 | 6,200 | 0.51 | |
| NoThinkBackbone=DeepSeek-R1-Distill-7B, Decoding Strategy=greedy decoding (pass@1)2026.04 | 59.5 | 4,000 | 0.65 | |
| LCPOBackbone=DeepSeek-R1-Distill-7B, Decoding Strategy=greedy decoding (pass@1)2026.04 | 58.6 | 3,800 | 0.6 | |
| OriginalBackbone=DeepSeek-R1-Distill-7B, Decoding Strategy=greedy decoding (pass@1)2026.04 | 58.1 | 8,500 | 0 | |
| NoThinkBackbone=Qwen3-4B, Decoding Strategy=greedy decoding (pass@1)2026.04 | 56.2 | 4,200 | -0.44 | |
| NoThinkBackbone=Qwen3-8B, Decoding Strategy=greedy decoding (pass@1)2026.04 | 55.2 | 4,100 | -0.73 |