Reasoning on HotpotQA (Solve Rate and Executability)
88.12Solve RateCapFlow
Evaluation results
| Method | Links | ||
|---|---|---|---|
| CapFlowType=Learning, Setting=Multi-domain, Passes=12026.02 | 88.12 | — | |
| CapFlowType=Learning, Setting=Cross-domain, Passes=1, Cross-domain Domain Mapping=Code,Math->Reason2026.02 | 86.37 | — | |
| ScoreFlowType=Learning, Setting=Single-domain, Iterations=52026.02 | 86 | — | |
| AFlowType=Refinement, Setting=Single-domain, Iterations=202026.02 | 85.87 | — | |
| ScoreFlowType=Learning, Setting=Multi-domain, Iterations=52026.02 | 85.37 | — | |
| ADASType=Refinement, Setting=Single-domain, Iterations=202026.02 | 82.84 | — | |
| CoT-SCType=Manual, Setting=Manual2026.02 | 82.07 | — | |
| CoTType=Manual, Setting=Manual2026.02 | 81.75 | — | |
| SPPType=Manual, Setting=Manual2026.02 | 81.62 | — | |
| GPT-4o-miniType=Manual, Setting=Manual2026.02 | 81.54 | — | |
| Self-RefineType=Manual, Setting=Manual2026.02 | 81.18 | — |