# Question Answering on HotpotQA (ASR, RSR, PPL) Source: [Question Answering on HotpotQA (ASR, RSR, PPL)]() Collection index: [llms.txt]() Data updated: 2026-04-10T06:48:32.134Z Evaluation of model performance on the HotpotQA dataset for Question Answering, measured using ASR, RSR, and PPL metrics. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Question Answering | | Dataset (including any stated split) | HotpotQA | | Metric | ASR | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 35 of 35 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [ASR](): Higher is better; unit: PERCENT. - [RSR](): Higher is better; unit: PERCENT. - [PPL](): Lower is better; unit: SCALAR. ## Recorded results | Method | ASR | Result date | Report paper | | --- | --- | --- | --- | | AuthChain | 90 | Not recorded | 68fa7af71e209131cea86070 | | AuthChain | 88 | Not recorded | 68fa7af71e209131cea86070 | | AuthChain | 87 | Not recorded | 68fa7af71e209131cea86070 | | AuthChain | 86 | Not recorded | 68fa7af71e209131cea86070 | | AuthChain | 86 | Not recorded | 68fa7af71e209131cea86070 | | AuthChain | 85 | Not recorded | 68fa7af71e209131cea86070 | | Authority | 82 | Not recorded | 68fa7af71e209131cea86070 | | Authority | 80 | Not recorded | 68fa7af71e209131cea86070 | | Authority | 80 | Not recorded | 68fa7af71e209131cea86070 | | CoE | 79 | Not recorded | 68fa7af71e209131cea86070 | | Authority | 78 | Not recorded | 68fa7af71e209131cea86070 | | Authority | 78 | Not recorded | 68fa7af71e209131cea86070 | | HRAG | 77 | Not recorded | 68fa7af71e209131cea86070 | | CoE | 77 | Not recorded | 68fa7af71e209131cea86070 | | CoE | 75 | Not recorded | 68fa7af71e209131cea86070 | | HRAG | 73 | Not recorded | 68fa7af71e209131cea86070 | | CoE | 71 | Not recorded | 68fa7af71e209131cea86070 | | CoE | 71 | Not recorded | 68fa7af71e209131cea86070 | | PRAG | 69 | Not recorded | 68fa7af71e209131cea86070 | | Authority | 66 | Not recorded | 68fa7af71e209131cea86070 | | PRAG | 63 | Not recorded | 68fa7af71e209131cea86070 | | CoE | 62 | Not recorded | 68fa7af71e209131cea86070 | | PRAG | 62 | Not recorded | 68fa7af71e209131cea86070 | | PRAG | 60 | Not recorded | 68fa7af71e209131cea86070 | | HRAG | 58 | Not recorded | 68fa7af71e209131cea86070 | | HRAG | 57 | Not recorded | 68fa7af71e209131cea86070 | | PRAG | 54 | Not recorded | 68fa7af71e209131cea86070 | | PRAG | 49 | Not recorded | 68fa7af71e209131cea86070 | | HRAG | 49 | Not recorded | 68fa7af71e209131cea86070 | | HRAG | 22 | Not recorded | 68fa7af71e209131cea86070 | ### AuthChain ASR: 90. Result ID: 69d89cb047f34ce924c0de8e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-3.5"}. This record does not assert independent reproduction. ### AuthChain ASR: 88. Result ID: 69d89cb047f34ce924c0de98. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-4o"}. This record does not assert independent reproduction. ### AuthChain ASR: 87. Result ID: 69d89cb047f34ce924c0dea7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Deepseek-V3-0324"}. This record does not assert independent reproduction. ### AuthChain ASR: 86. Result ID: 69d89cb047f34ce924c0de93. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-4"}. This record does not assert independent reproduction. ### AuthChain ASR: 86. Result ID: 69d89cb047f34ce924c0dea2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Llama3-70B"}. This record does not assert independent reproduction. ### AuthChain ASR: 85. Result ID: 69d89cb047f34ce924c0de9d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Llama3-8B"}. This record does not assert independent reproduction. ### Authority ASR: 82. Result ID: 69d89cb047f34ce924c0de8d. [Reporting paper]() Recorded evaluation configuration: {"Model":"GPT-3.5"}. This record does not assert independent reproduction. ### Authority ASR: 80. Result ID: 69d89cb047f34ce924c0dea1. [Reporting paper]() Recorded evaluation configuration: {"Model":"Llama3-70B"}. This record does not assert independent reproduction. ### Authority ASR: 80. Result ID: 69d89cb047f34ce924c0dea6. [Reporting paper]() Recorded evaluation configuration: {"Model":"Deepseek-V3-0324"}. This record does not assert independent reproduction. ### CoE ASR: 79. Result ID: 69d89cb047f34ce924c0de8c. [Reporting paper]() Recorded evaluation configuration: {"Model":"GPT-3.5"}. This record does not assert independent reproduction. ### Authority ASR: 78. Result ID: 69d89cb047f34ce924c0de97. [Reporting paper]() Recorded evaluation configuration: {"Model":"GPT-4o"}. This record does not assert independent reproduction. ### Authority ASR: 78. Result ID: 69d89cb047f34ce924c0de9c. [Reporting paper]() Recorded evaluation configuration: {"Model":"Llama3-8B"}. This record does not assert independent reproduction. ### HRAG ASR: 77. Result ID: 69d89cb047f34ce924c0de90. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-4"}. This record does not assert independent reproduction. ### CoE ASR: 77. Result ID: 69d89cb047f34ce924c0dea5. [Reporting paper]() Recorded evaluation configuration: {"Model":"Deepseek-V3-0324"}. This record does not assert independent reproduction. ### CoE ASR: 75. Result ID: 69d89cb047f34ce924c0dea0. [Reporting paper]() Recorded evaluation configuration: {"Model":"Llama3-70B"}. This record does not assert independent reproduction. ### HRAG ASR: 73. Result ID: 69d89cb047f34ce924c0dea4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Deepseek-V3-0324"}. This record does not assert independent reproduction. ### CoE ASR: 71. Result ID: 69d89cb047f34ce924c0de96. [Reporting paper]() Recorded evaluation configuration: {"Model":"GPT-4o"}. This record does not assert independent reproduction. ### CoE ASR: 71. Result ID: 69d89cb047f34ce924c0de9b. [Reporting paper]() Recorded evaluation configuration: {"Model":"Llama3-8B"}. This record does not assert independent reproduction. ### PRAG ASR: 69. Result ID: 69d89cb047f34ce924c0de8a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-3.5"}. This record does not assert independent reproduction. ### Authority ASR: 66. Result ID: 69d89cb047f34ce924c0de92. [Reporting paper]() Recorded evaluation configuration: {"Model":"GPT-4"}. This record does not assert independent reproduction. ### PRAG ASR: 63. Result ID: 69d89cb047f34ce924c0dea3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Deepseek-V3-0324"}. This record does not assert independent reproduction. ### CoE ASR: 62. Result ID: 69d89cb047f34ce924c0de91. [Reporting paper]() Recorded evaluation configuration: {"Model":"GPT-4"}. This record does not assert independent reproduction. ### PRAG ASR: 62. Result ID: 69d89cb047f34ce924c0de99. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Llama3-8B"}. This record does not assert independent reproduction. ### PRAG ASR: 60. Result ID: 69d89cb047f34ce924c0de9e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Llama3-70B"}. This record does not assert independent reproduction. ### HRAG ASR: 58. Result ID: 69d89cb047f34ce924c0de9a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Llama3-8B"}. This record does not assert independent reproduction. ### HRAG ASR: 57. Result ID: 69d89cb047f34ce924c0de8b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-3.5"}. This record does not assert independent reproduction. ### PRAG ASR: 54. Result ID: 69d89cb047f34ce924c0de94. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-4o"}. This record does not assert independent reproduction. ### PRAG ASR: 49. Result ID: 69d89cb047f34ce924c0de8f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-4"}. This record does not assert independent reproduction. ### HRAG ASR: 49. Result ID: 69d89cb047f34ce924c0de95. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-4o"}. This record does not assert independent reproduction. ### HRAG ASR: 22. Result ID: 69d89cb047f34ce924c0de9f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Llama3-70B"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.