Multi-hop Open-domain Question Answering on Quartz
94.1AccuracyOracle
Evaluation results
| Method | Links | |
|---|---|---|
| OracleBackbone=code-davinci-002, Reasoning Category=implicit, Number of Examples=374, Reasoning Strategy=Oracle2023.04 | 94.1 | |
| MCRBackbone=code-davinci-002, Reasoning Category=implicit, Number of Examples=374, Reasoning Strategy=MCR (5-chains)2023.04 | 81.6 | |
| SCRBackbone=code-davinci-002, Reasoning Category=implicit, Number of Examples=374, Reasoning Strategy=SCR (1-chain)2023.04 | 80.7 | |
| SABackbone=code-davinci-002, Reasoning Category=implicit, Number of Examples=374, Reasoning Strategy=SA2023.04 | 78.3 | |
| SC@3Backbone=code-davinci-002, Reasoning Category=implicit, Number of Examples=374, Reasoning Strategy=SC@32023.04 | 78.2 | |
| SC@5Backbone=code-davinci-002, Reasoning Category=implicit, Number of Examples=374, Reasoning Strategy=SC@52023.04 | 77.6 |