General Reasoning on StratQA
87.8AccuracyProcess Supervision
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Process SupervisionModel=GPT-4o2025.12 | 87.8 | — | |
| Reflection-CoTModel=GPT-4o2025.12 | 87.2 | — | |
| DenserModel=GPT-4o2025.12 | 87.1 | — | |
| Process SupervisionBackbone=Qwen3-32B-think2025.12 | 86.6 | — | |
| Process SupervisionModel=DeepSeek-V32025.12 | 86.5 | — | |
| DenserBackbone=Qwen3-32B-think2025.12 | 86.5 | — | |
| Tree-of-ThoughtModel=GPT-4o2025.12 | 86.4 | — | |
| Self-VerificationModel=GPT-4o2025.12 | 86.4 | — | |
| Reflection-CoTBackbone=Qwen3-32B-think2025.12 | 86 | — | |
| Reflection-CoTModel=DeepSeek-V32025.12 | 85.9 | — | |
| Self-ConsistencyModel=GPT-4o2025.12 | 85.8 | — | |
| DenserModel=DeepSeek-V32025.12 | 85.6 | — | |
| Think-to-ThinkModel=GPT-4o2025.12 | 85.1 | — | |
| DenserBackbone=Qwen3-32B2025.12 | 85.1 | — | |
| Tree-of-ThoughtModel=DeepSeek-V32025.12 | 84.8 | — | |
| Process SupervisionBackbone=Qwen3-32B2025.12 | 84.8 | — | |
| Tree-of-ThoughtBackbone=Qwen3-32B-think2025.12 | 84.8 | — | |
| Self-VerificationBackbone=Qwen3-32B-think2025.12 | 84.8 | — | |
| Self-VerificationModel=DeepSeek-V32025.12 | 84.7 | — | |
| Self-ConsistencyModel=DeepSeek-V32025.12 | 84.2 | — | |
| Reflection-CoTBackbone=Qwen3-32B2025.12 | 84.2 | — | |
| Self-ConsistencyBackbone=Qwen3-32B-think2025.12 | 84.2 | — | |
| Think-to-ThinkModel=DeepSeek-V32025.12 | 83.5 | — | |
| Think-to-ThinkBackbone=Qwen3-32B-think2025.12 | 83.5 | — | |
| Self-VerificationBackbone=Qwen3-32B2025.12 | 83.2 | — | |
| Chain-of-ThoughtModel=GPT-4o2025.12 | 83.1 | — | |
| Tree-of-ThoughtBackbone=Qwen3-32B2025.12 | 83 | — | |
| Process SupervisionModel=o1-mini2025.12 | 82.9 | — | |
| DenserModel=o1-mini2025.12 | 82.7 | — | |
| Self-ConsistencyBackbone=Qwen3-32B2025.12 | 82.4 | — | |
| Reflection-CoTModel=o1-mini2025.12 | 82.3 | — | |
| Think-to-ThinkBackbone=Qwen3-32B2025.12 | 81.7 | — | |
| Self-VerificationModel=o1-mini2025.12 | 81.6 | — | |
| Chain-of-ThoughtModel=DeepSeek-V32025.12 | 81.5 | — | |
| Chain-of-ThoughtBackbone=Qwen3-32B-think2025.12 | 81.4 | — | |
| Tree-of-ThoughtModel=o1-mini2025.12 | 81 | — | |
| Self-ConsistencyModel=o1-mini2025.12 | 80.4 | — | |
| DenserBackbone=Qwen3-14B2025.12 | 80.3 | -58.7 | |
| DenserBackbone=Qwen3-8B-think2025.12 | 80.1 | — | |
| Process SupervisionBackbone=Qwen3-8B-think2025.12 | 79.9 | — | |
| Think-to-ThinkModel=o1-mini2025.12 | 79.7 | — | |
| Chain-of-ThoughtBackbone=Qwen3-32B2025.12 | 79.6 | — | |
| Reflection-CoTBackbone=Qwen3-8B-think2025.12 | 79.3 | — | |
| Self-VerificationBackbone=Qwen3-14B2025.12 | 79.2 | 142.8 | |
| DenserBackbone=Qwen3-8B2025.12 | 78.9 | — | |
| Process SupervisionBackbone=Qwen3-14B-no-think2025.12 | 78.9 | — | |
| DenserBackbone=Qwen3-14B-no-think2025.12 | 78.9 | — | |
| Process SupervisionBackbone=Qwen3-14B2025.12 | 78.6 | 156.3 | |
| Self-VerificationBackbone=Qwen3-8B-think2025.12 | 78.3 | — | |
| Reflection-CoTBackbone=Qwen3-14B-no-think2025.12 | 78.3 | — | |
| Process SupervisionBackbone=Qwen3-8B2025.12 | 78.2 | — | |
| Tree-of-ThoughtBackbone=Qwen3-8B-think2025.12 | 78.1 | — | |
| Reflection-CoTBackbone=Qwen3-14B2025.12 | 78 | 127.6 | |
| Chain-of-ThoughtModel=o1-mini2025.12 | 77.9 | — | |
| TokenSkip (0.9 ratio)Backbone=Qwen3-14B2025.12 | 77.9 | -53.5 | |
| Reflection-CoTBackbone=Qwen3-8B2025.12 | 77.6 | — | |
| Self-ConsistencyBackbone=Qwen3-8B-think2025.12 | 77.5 | — | |
| DenserBackbone=Qwen3-4B-think2025.12 | 77.4 | — | |
| Tree-of-ThoughtBackbone=Qwen3-14B2025.12 | 77.1 | 345.7 | |
| Tree-of-ThoughtBackbone=Qwen3-14B-no-think2025.12 | 77.1 | — | |
| Self-VerificationBackbone=Qwen3-14B-no-think2025.12 | 77.1 | — | |
| Self-ConsistencyBackbone=Qwen3-14B2025.12 | 76.8 | 289.4 | |
| Think-to-ThinkBackbone=Qwen3-8B-think2025.12 | 76.8 | — | |
| Process SupervisionBackbone=Qwen3-4B-think2025.12 | 76.7 | — | |
| Think-to-ThinkBackbone=Qwen3-14B2025.12 | 76.5 | 187.2 | |
| Self-VerificationBackbone=Qwen3-8B2025.12 | 76.5 | — | |
| Self-ConsistencyBackbone=Qwen3-14B-no-think2025.12 | 76.5 | — | |
| Tree-of-ThoughtBackbone=Qwen3-8B2025.12 | 76.4 | — | |
| Reflection-CoTBackbone=Qwen3-4B-think2025.12 | 76.1 | — | |
| Self-ConsistencyBackbone=Qwen3-8B2025.12 | 75.8 | — | |
| Think-to-ThinkBackbone=Qwen3-14B-no-think2025.12 | 75.8 | — | |
| Chain-of-Thought (CoT)Backbone=Qwen3-14B2025.12 | 75.2 | 0 | |
| Self-VerificationBackbone=Qwen3-4B-think2025.12 | 75.2 | — | |
| Think-to-ThinkBackbone=Qwen3-8B2025.12 | 75.1 | — | |
| Tree-of-ThoughtBackbone=Qwen3-4B-think2025.12 | 74.8 | — | |
| Chain-of-ThoughtBackbone=Qwen3-8B-think2025.12 | 74.7 | — | |
| DenserBackbone=Qwen3-4B2025.12 | 74.6 | — | |
| Self-ConsistencyBackbone=Qwen3-4B-think2025.12 | 74.2 | — | |
| BeConciseBackbone=Qwen3-14B2025.12 | 74.1 | -54.2 | |
| Process SupervisionBackbone=Qwen3-4B2025.12 | 74 | — | |
| Chain-of-ThoughtBackbone=Qwen3-14B-no-think2025.12 | 73.8 | — | |
| AbbreWordsBackbone=Qwen3-14B2025.12 | 73.5 | -50.8 | |
| Think-to-ThinkBackbone=Qwen3-4B-think2025.12 | 73.5 | — | |
| Reflection-CoTBackbone=Qwen3-4B2025.12 | 73.4 | — | |
| Chain-of-ThoughtBackbone=Qwen3-8B2025.12 | 73.1 | — | |
| Self-VerificationBackbone=Qwen3-4B2025.12 | 72.8 | — | |
| Tree-of-ThoughtBackbone=Qwen3-4B2025.12 | 72.3 | — | |
| Self-ConsistencyBackbone=Qwen3-4B2025.12 | 71.8 | — | |
| Chain-of-ThoughtBackbone=Qwen3-4B-think2025.12 | 71.8 | — | |
| Think-to-ThinkBackbone=Qwen3-4B2025.12 | 70.9 | — | |
| Chain-of-ThoughtBackbone=Qwen3-4B2025.12 | 69.5 | — |