Multi-hop Open-domain Question Answering on Fermi
65.1AccuracyOracle
Evaluation results
| Method | Links | |
|---|---|---|
| OracleBackbone=code-davinci-002, Reasoning Category=implicit, Number of Examples=286, Reasoning Strategy=Oracle2023.04 | 65.1 | |
| MCRBackbone=code-davinci-002, Reasoning Category=implicit, Number of Examples=286, Reasoning Strategy=MCR (5-chains)2023.04 | 38.9 | |
| SC@3Backbone=code-davinci-002, Reasoning Category=implicit, Number of Examples=286, Reasoning Strategy=SC@32023.04 | 38.4 | |
| SABackbone=code-davinci-002, Reasoning Category=implicit, Number of Examples=286, Reasoning Strategy=SA2023.04 | 38.3 | |
| SC@5Backbone=code-davinci-002, Reasoning Category=implicit, Number of Examples=286, Reasoning Strategy=SC@52023.04 | 38.3 | |
| SCRBackbone=code-davinci-002, Reasoning Category=implicit, Number of Examples=286, Reasoning Strategy=SCR (1-chain)2023.04 | 38.1 |