Multi-hop Commonsense Reasoning on StrategyQA sampled 50 (val)
90AccuracyCoS
Evaluation results
| Method | Links | |
|---|---|---|
| CoSmode=hybrid2026.02 | 90 | |
| Directtemperature=02026.02 | 87.5 | |
| Chain-of-Thoughttemperature=02026.02 | 87 | |
| Structured CoTtemperature=02026.02 | 85 | |
| Self-Consistencytemperature=0.7, k=52026.02 | 85 |