Multi-hop Open-domain Question Answering on Feverous
0.88AccuracyOracle
Evaluation Results
| Method | Links | |
|---|---|---|
| OracleBackbone=code-davinci-002, Reasoning Category=explicit, Number of Examples=500, Reasoning Strategy=Oracle2023.04 | 0.88 | |
| MCRBackbone=code-davinci-002, Reasoning Category=explicit, Number of Examples=500, Reasoning Strategy=MCR (5-chains)2023.04 | 0.694 | |
| SC@5Backbone=code-davinci-002, Reasoning Category=explicit, Number of Examples=500, Reasoning Strategy=SC@52023.04 | 0.679 | |
| SC@3Backbone=code-davinci-002, Reasoning Category=explicit, Number of Examples=500, Reasoning Strategy=SC@32023.04 | 0.678 | |
| SABackbone=code-davinci-002, Reasoning Category=explicit, Number of Examples=500, Reasoning Strategy=SA2023.04 | 0.66 | |
| SCRBackbone=code-davinci-002, Reasoning Category=explicit, Number of Examples=500, Reasoning Strategy=SCR (1-chain)2023.04 | 0.651 |