Multi-hop Question Answering on StrategyQA (dev)
79.8AccuracyCoT+SC@40
Evaluation results
| Method | Links | |
|---|---|---|
| CoT+SC@40Retrieval=no, LLM=code-davinci-002, Reasoning Chains=402023.04 | 79.8 | |
| MCR+SC@3Retrieval=yes, LLM=code-davinci-002, Reasoning Chains=152023.04 | 76.4 | |
| MCRRetrieval=yes, LLM=code-davinci-002, Reasoning Chains=52023.04 | 73.6 | |
| CoTRetrieval=no, LLM=code-davinci-002, Reasoning Chains=12023.04 | 73.4 | |
| Self-Ask (ours)Retrieval=yes, LLM=code-davinci-002, Reasoning Chains=12023.04 | 69.3 |