Structural Reasoning on C2S
77.9AccuracyGPT-4o
Evaluation results
| Method | Links | |
|---|---|---|
| GPT-4oEvaluation Protocol=0-Shot, Reasoning Framework=Maieutic Prompting2025.05 | 77.9 | |
| Always Tell Me The OddsBackbone=Qwen2.5-14B-Instruct, Data Augmentation=+Syn, Training Strategy=+R, Reasoning Framework=Maieutic Prompting2025.05 | 75.6 | |
| Always Tell Me The OddsBackbone=Qwen2.5-14B-Instruct, Data Augmentation=+Syn, Reasoning Framework=Maieutic Prompting2025.05 | 75.2 | |
| Always Tell Me The OddsBackbone=Qwen2.5-14B-Instruct, Reasoning Framework=Maieutic Prompting2025.05 | 73.5 | |
| DeepSeek-R1-Distill-Qwen-32BEvaluation Protocol=0-Shot, Reasoning Framework=Maieutic Prompting2025.05 | 68.5 | |
| Always Tell Me The OddsBackbone=Qwen2.5-7B-Instruct, Reasoning Framework=Maieutic Prompting2025.05 | 68.4 | |
| Always Tell Me The OddsBackbone=Qwen2.5-8B-Instruct, Reasoning Framework=Maieutic Prompting2025.05 | 65.5 | |
| RoBERTa-LType=Encoder, Reasoning Framework=Maieutic Prompting2025.05 | 50.6 | |
| Llama-3-InstructEvaluation Protocol=Probe, Size=14B, Reasoning Framework=Maieutic Prompting2025.05 | 49.4 |