Multi-hop Open-domain Question Answering on Bamboogle
77.3AccuracyOracle
Evaluation Results
| Method | Links | |
|---|---|---|
| OracleBackbone=code-davinci-002, Reasoning Category=explicit, Number of Examples=120, Reasoning Strategy=Oracle2023.04 | 77.3 | |
| MCRBackbone=code-davinci-002, Reasoning Category=explicit, Number of Examples=120, Reasoning Strategy=MCR (5-chains)2023.04 | 66.5 | |
| SC@5Backbone=code-davinci-002, Reasoning Category=explicit, Number of Examples=120, Reasoning Strategy=SC@52023.04 | 65 | |
| SCRBackbone=code-davinci-002, Reasoning Category=explicit, Number of Examples=120, Reasoning Strategy=SCR (1-chain)2023.04 | 64.7 | |
| SABackbone=code-davinci-002, Reasoning Category=explicit, Number of Examples=120, Reasoning Strategy=SA2023.04 | 64.6 | |
| SC@3Backbone=code-davinci-002, Reasoning Category=explicit, Number of Examples=120, Reasoning Strategy=SC@32023.04 | 64.6 |