Logical Reasoning on ProofW (Accuracy)
83.7AccuracyDenser
Evaluation results
| Method | Links | |
|---|---|---|
| DenserBackbone=Qwen3-32B-think2025.12 | 83.7 | |
| Process SupervisionModel=GPT-4o2025.12 | 83.6 | |
| DenserModel=GPT-4o2025.12 | 83.5 | |
| Process SupervisionBackbone=Qwen3-32B-think2025.12 | 83.5 | |
| Reflection-CoTModel=GPT-4o2025.12 | 83 | |
| Reflection-CoTBackbone=Qwen3-32B-think2025.12 | 82.9 | |
| Self-VerificationModel=GPT-4o2025.12 | 82.4 | |
| Tree-of-ThoughtModel=GPT-4o2025.12 | 82.3 | |
| Process SupervisionModel=DeepSeek-V32025.12 | 82.1 | |
| DenserModel=DeepSeek-V32025.12 | 82 | |
| DenserBackbone=Qwen3-32B2025.12 | 82 | |
| Self-VerificationBackbone=Qwen3-32B-think2025.12 | 81.9 | |
| Tree-of-ThoughtBackbone=Qwen3-32B-think2025.12 | 81.8 | |
| Process SupervisionBackbone=Qwen3-32B2025.12 | 81.7 | |
| Self-ConsistencyModel=GPT-4o2025.12 | 81.6 | |
| Reflection-CoTModel=DeepSeek-V32025.12 | 81.5 | |
| Reflection-CoTBackbone=Qwen3-32B2025.12 | 81.1 | |
| Self-ConsistencyBackbone=Qwen3-32B-think2025.12 | 81.1 | |
| Think-to-ThinkModel=GPT-4o2025.12 | 80.9 | |
| Self-VerificationModel=DeepSeek-V32025.12 | 80.9 | |
| Tree-of-ThoughtModel=DeepSeek-V32025.12 | 80.8 | |
| Think-to-ThinkBackbone=Qwen3-32B-think2025.12 | 80.3 | |
| DenserModel=o1-mini2025.12 | 80.1 | |
| Self-ConsistencyModel=DeepSeek-V32025.12 | 80.1 | |
| Self-VerificationBackbone=Qwen3-32B2025.12 | 80.1 | |
| Process SupervisionModel=o1-mini2025.12 | 79.9 | |
| Tree-of-ThoughtBackbone=Qwen3-32B2025.12 | 79.9 | |
| Think-to-ThinkModel=DeepSeek-V32025.12 | 79.4 | |
| Reflection-CoTModel=o1-mini2025.12 | 79.3 | |
| Self-ConsistencyBackbone=Qwen3-32B2025.12 | 79.2 | |
| Chain-of-ThoughtModel=GPT-4o2025.12 | 78.9 | |
| Self-VerificationModel=o1-mini2025.12 | 78.7 | |
| Tree-of-ThoughtModel=o1-mini2025.12 | 78.6 | |
| Think-to-ThinkBackbone=Qwen3-32B2025.12 | 78.5 | |
| Chain-of-ThoughtBackbone=Qwen3-32B-think2025.12 | 78.2 | |
| Self-ConsistencyModel=o1-mini2025.12 | 77.9 | |
| Chain-of-ThoughtModel=DeepSeek-V32025.12 | 77.4 | |
| Think-to-ThinkModel=o1-mini2025.12 | 77.2 | |
| DenserBackbone=Qwen3-8B-think2025.12 | 76.7 | |
| Chain-of-ThoughtBackbone=Qwen3-32B2025.12 | 76.4 | |
| Process SupervisionBackbone=Qwen3-8B-think2025.12 | 76.2 | |
| DenserBackbone=Qwen3-14B-no-think2025.12 | 75.8 | |
| Reflection-CoTBackbone=Qwen3-8B-think2025.12 | 75.6 | |
| Process SupervisionBackbone=Qwen3-14B-no-think2025.12 | 75.4 | |
| Chain-of-ThoughtModel=o1-mini2025.12 | 75.1 | |
| Self-VerificationBackbone=Qwen3-8B-think2025.12 | 74.9 | |
| DenserBackbone=Qwen3-8B2025.12 | 74.8 | |
| Reflection-CoTBackbone=Qwen3-14B-no-think2025.12 | 74.8 | |
| Tree-of-ThoughtBackbone=Qwen3-8B-think2025.12 | 74.4 | |
| Process SupervisionBackbone=Qwen3-8B2025.12 | 74 | |
| Self-VerificationBackbone=Qwen3-14B-no-think2025.12 | 73.9 | |
| Self-ConsistencyBackbone=Qwen3-8B-think2025.12 | 73.7 | |
| Tree-of-ThoughtBackbone=Qwen3-14B-no-think2025.12 | 73.6 | |
| Reflection-CoTBackbone=Qwen3-8B2025.12 | 73.4 | |
| DenserBackbone=Qwen3-4B-think2025.12 | 73.2 | |
| Think-to-ThinkBackbone=Qwen3-8B-think2025.12 | 72.9 | |
| Self-ConsistencyBackbone=Qwen3-14B-no-think2025.12 | 72.9 | |
| Self-VerificationBackbone=Qwen3-8B2025.12 | 72.6 | |
| Tree-of-ThoughtBackbone=Qwen3-8B2025.12 | 72.2 | |
| Process SupervisionBackbone=Qwen3-4B-think2025.12 | 72.1 | |
| Think-to-ThinkBackbone=Qwen3-14B-no-think2025.12 | 72.1 | |
| Reflection-CoTBackbone=Qwen3-4B-think2025.12 | 71.5 | |
| Self-ConsistencyBackbone=Qwen3-8B2025.12 | 71.5 | |
| Chain-of-ThoughtBackbone=Qwen3-8B-think2025.12 | 71.2 | |
| Self-VerificationBackbone=Qwen3-4B-think2025.12 | 71 | |
| Think-to-ThinkBackbone=Qwen3-8B2025.12 | 70.7 | |
| Chain-of-ThoughtBackbone=Qwen3-14B-no-think2025.12 | 70.4 | |
| Tree-of-ThoughtBackbone=Qwen3-4B-think2025.12 | 70.3 | |
| DenserBackbone=Qwen3-4B2025.12 | 70.1 | |
| Process SupervisionBackbone=Qwen3-4B2025.12 | 69.8 | |
| Self-ConsistencyBackbone=Qwen3-4B-think2025.12 | 69.7 | |
| Chain-of-ThoughtBackbone=Qwen3-8B2025.12 | 69.3 | |
| Reflection-CoTBackbone=Qwen3-4B2025.12 | 69.2 | |
| Think-to-ThinkBackbone=Qwen3-4B-think2025.12 | 69 | |
| Self-VerificationBackbone=Qwen3-4B2025.12 | 68.4 | |
| Tree-of-ThoughtBackbone=Qwen3-4B2025.12 | 68.1 | |
| Chain-of-ThoughtBackbone=Qwen3-4B-think2025.12 | 67.9 | |
| Self-ConsistencyBackbone=Qwen3-4B2025.12 | 67.4 | |
| Think-to-ThinkBackbone=Qwen3-4B2025.12 | 66.9 | |
| Chain-of-ThoughtBackbone=Qwen3-4B2025.12 | 65.8 |