# Retrieval-Augmented Generation on Novel Source: [Retrieval-Augmented Generation on Novel]() Collection index: [llms.txt]() Data updated: 2026-03-18T07:52:25.359Z Evaluation of Retrieval-Augmented Generation performance on the Novel dataset, focusing on indexing time, querying time, and token costs. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Retrieval-Augmented Generation | | Dataset (including any stated split) | Novel | | Metric | Indexing Time (mins) | | Unit | TIME | | Direction | Lower is better | | Results loaded | 11 of 11 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Indexing Time (mins)](): Lower is better; unit: TIME. - [Querying Time (mins)](): Lower is better; unit: TIME. - [Input Tokens (per query)](): Lower is better; unit: SCALAR. - [Output Tokens (per query)](): Lower is better; unit: SCALAR. ## Recorded results | Method | Indexing Time (mins) | Result date | Report paper | | --- | --- | --- | --- | | NaiveRAG | 13 | Not recorded | 6912c3052828b7cc6937dbc7 | | MIXRAG | 17 | Not recorded | 6912c3052828b7cc6937dbc7 | | G-Retriever | 19 | Not recorded | 6912c3052828b7cc6937dbc7 | | L.LLMLingua | 51 | Not recorded | 6912c3052828b7cc6937dbc7 | | AGRAG | 65 | Not recorded | 6912c3052828b7cc6937dbc7 | | SiReRAG | 85 | Not recorded | 6912c3052828b7cc6937dbc7 | | HippoRAG2 | 95 | Not recorded | 6912c3052828b7cc6937dbc7 | | F.GraphRAG | 106 | Not recorded | 6912c3052828b7cc6937dbc7 | | LightRAG | 166 | Not recorded | 6912c3052828b7cc6937dbc7 | | GraphRAG | 347 | Not recorded | 6912c3052828b7cc6937dbc7 | | RAPTOR | 464 | Not recorded | 6912c3052828b7cc6937dbc7 | ### NaiveRAG Indexing Time (mins): 13. Result ID: 69ba59a047f34ce924a3f989. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Category":"Traditional RAG","LLM Backbone":"Qwen2.5-14B-Instruct"}. This record does not assert independent reproduction. ### MIXRAG Indexing Time (mins): 17. Result ID: 69ba59a047f34ce924a3f98e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Category":"Community-based RAG","LLM Backbone":"Qwen2.5-14B-Instruct"}. This record does not assert independent reproduction. ### G-Retriever Indexing Time (mins): 19. Result ID: 69ba59a047f34ce924a3f98d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Category":"Community-based RAG","LLM Backbone":"Qwen2.5-14B-Instruct"}. This record does not assert independent reproduction. ### L.LLMLingua Indexing Time (mins): 51. Result ID: 69ba59a047f34ce924a3f98a. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Category":"Traditional RAG","LLM Backbone":"Qwen2.5-14B-Instruct"}. This record does not assert independent reproduction. ### AGRAG Indexing Time (mins): 65. Result ID: 69ba59a047f34ce924a3f993. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Category":"Walking-based RAG","LLM Backbone":"Qwen2.5-14B-Instruct"}. This record does not assert independent reproduction. ### SiReRAG Indexing Time (mins): 85. Result ID: 69ba59a047f34ce924a3f98c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Category":"Tree-based RAG","LLM Backbone":"Qwen2.5-14B-Instruct"}. This record does not assert independent reproduction. ### HippoRAG2 Indexing Time (mins): 95. Result ID: 69ba59a047f34ce924a3f991. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Category":"Walking-based RAG","LLM Backbone":"Qwen2.5-14B-Instruct"}. This record does not assert independent reproduction. ### F.GraphRAG Indexing Time (mins): 106. Result ID: 69ba59a047f34ce924a3f992. [Reporting paper]() Recorded evaluation configuration: {"Category":"Walking-based RAG","LLM Backbone":"Qwen2.5-14B-Instruct"}. This record does not assert independent reproduction. ### LightRAG Indexing Time (mins): 166. Result ID: 69ba59a047f34ce924a3f990. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Category":"Community-based RAG","LLM Backbone":"Qwen2.5-14B-Instruct"}. This record does not assert independent reproduction. ### GraphRAG Indexing Time (mins): 347. Result ID: 69ba59a047f34ce924a3f98f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Category":"Community-based RAG","LLM Backbone":"Qwen2.5-14B-Instruct"}. This record does not assert independent reproduction. ### RAPTOR Indexing Time (mins): 464. Result ID: 69ba59a047f34ce924a3f98b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Category":"Tree-based RAG","LLM Backbone":"Qwen2.5-14B-Instruct"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.