# Question Answering on TriviaQA (test) (Unreliability Rate (%)) Source: [Question Answering on TriviaQA (test) (Unreliability Rate (%))]() Collection index: [llms.txt]() Data updated: 2026-06-30T09:21:57.213Z Evaluation of model performance on the test split of the TriviaQA dataset for Question Answering, reporting the Unreliability Rate. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Question Answering | | Dataset (including any stated split) | TriviaQA (test) | | Metric | Unreliability Rate | | Unit | PERCENT | | Direction | Lower is better | | Results loaded | 28 of 28 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Unreliability Rate](): Lower is better; unit: PERCENT. ## Recorded results | Method | Unreliability Rate | Result date | Report paper | | --- | --- | --- | --- | | KbSD | 28.9 | Not recorded | 6a434da0ba73165dbb743dc3 | | KbPO | 32.6 | Not recorded | 6a434da0ba73165dbb743dc3 | | KbSD | 34.8 | Not recorded | 6a434da0ba73165dbb743dc3 | | KbPO | 39.9 | Not recorded | 6a434da0ba73165dbb743dc3 | | Search-R1 | 44.09 | Not recorded | 6a434da0ba73165dbb743dc3 | | Search-R1 | 44.92 | Not recorded | 6a434da0ba73165dbb743dc3 | | TCRAG | 45.22 | Not recorded | 6a434da0ba73165dbb743dc3 | | ReACT | 45.45 | Not recorded | 6a434da0ba73165dbb743dc3 | | ReSearch | 46.07 | Not recorded | 6a434da0ba73165dbb743dc3 | | ARPO | 46.34 | Not recorded | 6a434da0ba73165dbb743dc3 | | Mem1 | 48.96 | Not recorded | 6a434da0ba73165dbb743dc3 | | TCRAG | 49.54 | Not recorded | 6a434da0ba73165dbb743dc3 | | IRCOT | 50.57 | Not recorded | 6a434da0ba73165dbb743dc3 | | COT | 50.67 | Not recorded | 6a434da0ba73165dbb743dc3 | | IRCOT | 50.81 | Not recorded | 6a434da0ba73165dbb743dc3 | | Base | 50.92 | Not recorded | 6a434da0ba73165dbb743dc3 | | FL-RAG | 51.5 | Not recorded | 6a434da0ba73165dbb743dc3 | | ReSearch | 51.75 | Not recorded | 6a434da0ba73165dbb743dc3 | | AEPO | 52.22 | Not recorded | 6a434da0ba73165dbb743dc3 | | ReACT | 53.96 | Not recorded | 6a434da0ba73165dbb743dc3 | | FS-RAG | 54.62 | Not recorded | 6a434da0ba73165dbb743dc3 | | FL-RAG | 57.34 | Not recorded | 6a434da0ba73165dbb743dc3 | | ARPO | 59.84 | Not recorded | 6a434da0ba73165dbb743dc3 | | COT | 60.38 | Not recorded | 6a434da0ba73165dbb743dc3 | | Base | 61.16 | Not recorded | 6a434da0ba73165dbb743dc3 | | FS-RAG | 64.98 | Not recorded | 6a434da0ba73165dbb743dc3 | | Mem1 | 66.91 | Not recorded | 6a434da0ba73165dbb743dc3 | | AEPO | 82.47 | Not recorded | 6a434da0ba73165dbb743dc3 | ### KbSD Unreliability Rate: 28.9. Result ID: 6a438a9afbc373592c957915. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B","Paradigm":"RL-based Agentic RAG"}. This record does not assert independent reproduction. ### KbPO Unreliability Rate: 32.6. Result ID: 6a438a9afbc373592c957914. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B","Paradigm":"RL-based Agentic RAG"}. This record does not assert independent reproduction. ### KbSD Unreliability Rate: 34.8. Result ID: 6a438a9afbc373592c957907. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-3B","Paradigm":"RL-based Agentic RAG"}. This record does not assert independent reproduction. ### KbPO Unreliability Rate: 39.9. Result ID: 6a438a9afbc373592c957906. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-3B","Paradigm":"RL-based Agentic RAG"}. This record does not assert independent reproduction. ### Search-R1 Unreliability Rate: 44.09. Result ID: 6a438a9afbc373592c957910. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B","Paradigm":"RL-based Agentic RAG"}. This record does not assert independent reproduction. ### Search-R1 Unreliability Rate: 44.92. Result ID: 6a438a9afbc373592c957902. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-3B","Paradigm":"RL-based Agentic RAG"}. This record does not assert independent reproduction. ### TCRAG Unreliability Rate: 45.22. Result ID: 6a438a9afbc373592c95790e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B","Paradigm":"Agentic RAG"}. This record does not assert independent reproduction. ### ReACT Unreliability Rate: 45.45. Result ID: 6a438a9afbc373592c95790c. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B","Paradigm":"Agentic RAG"}. This record does not assert independent reproduction. ### ReSearch Unreliability Rate: 46.07. Result ID: 6a438a9afbc373592c957901. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-3B","Paradigm":"RL-based Agentic RAG"}. This record does not assert independent reproduction. ### ARPO Unreliability Rate: 46.34. Result ID: 6a438a9afbc373592c957904. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-3B","Paradigm":"RL-based Agentic RAG"}. This record does not assert independent reproduction. ### Mem1 Unreliability Rate: 48.96. Result ID: 6a438a9afbc373592c957913. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B","Paradigm":"RL-based Agentic RAG"}. This record does not assert independent reproduction. ### TCRAG Unreliability Rate: 49.54. Result ID: 6a438a9afbc373592c957900. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-3B","Paradigm":"Agentic RAG"}. This record does not assert independent reproduction. ### IRCOT Unreliability Rate: 50.57. Result ID: 6a438a9afbc373592c95790d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B","Paradigm":"Agentic RAG"}. This record does not assert independent reproduction. ### COT Unreliability Rate: 50.67. Result ID: 6a438a9afbc373592c957909. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B","Paradigm":"No RAG"}. This record does not assert independent reproduction. ### IRCOT Unreliability Rate: 50.81. Result ID: 6a438a9afbc373592c9578ff. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-3B","Paradigm":"Agentic RAG"}. This record does not assert independent reproduction. ### Base Unreliability Rate: 50.92. Result ID: 6a438a9afbc373592c957908. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B","Paradigm":"No RAG"}. This record does not assert independent reproduction. ### FL-RAG Unreliability Rate: 51.5. Result ID: 6a438a9afbc373592c9578fd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-3B","Paradigm":"Naive RAG"}. This record does not assert independent reproduction. ### ReSearch Unreliability Rate: 51.75. Result ID: 6a438a9afbc373592c95790f. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B","Paradigm":"RL-based Agentic RAG"}. This record does not assert independent reproduction. ### AEPO Unreliability Rate: 52.22. Result ID: 6a438a9afbc373592c957903. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-3B","Paradigm":"RL-based Agentic RAG"}. This record does not assert independent reproduction. ### ReACT Unreliability Rate: 53.96. Result ID: 6a438a9afbc373592c9578fe. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-3B","Paradigm":"Agentic RAG"}. This record does not assert independent reproduction. ### FS-RAG Unreliability Rate: 54.62. Result ID: 6a438a9afbc373592c9578fc. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-3B","Paradigm":"Naive RAG"}. This record does not assert independent reproduction. ### FL-RAG Unreliability Rate: 57.34. Result ID: 6a438a9afbc373592c95790b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B","Paradigm":"Naive RAG"}. This record does not assert independent reproduction. ### ARPO Unreliability Rate: 59.84. Result ID: 6a438a9afbc373592c957912. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B","Paradigm":"RL-based Agentic RAG"}. This record does not assert independent reproduction. ### COT Unreliability Rate: 60.38. Result ID: 6a438a9afbc373592c9578fb. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-3B","Paradigm":"No RAG"}. This record does not assert independent reproduction. ### Base Unreliability Rate: 61.16. Result ID: 6a438a9afbc373592c9578fa. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-3B","Paradigm":"No RAG"}. This record does not assert independent reproduction. ### FS-RAG Unreliability Rate: 64.98. Result ID: 6a438a9afbc373592c95790a. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B","Paradigm":"Naive RAG"}. This record does not assert independent reproduction. ### Mem1 Unreliability Rate: 66.91. Result ID: 6a438a9afbc373592c957905. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-3B","Paradigm":"RL-based Agentic RAG"}. This record does not assert independent reproduction. ### AEPO Unreliability Rate: 82.47. Result ID: 6a438a9afbc373592c957911. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B","Paradigm":"RL-based Agentic RAG"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.