# Retrieval-Augmented Generation on IFS-REL Source: [Retrieval-Augmented Generation on IFS-REL]() Collection index: [llms.txt]() Data updated: 2026-03-18T07:52:25.430Z Evaluation of Retrieval-Augmented Generation performance on the IFS-REL dataset, focusing on system efficiency metrics such as indexing time, query time, and token costs. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Retrieval-Augmented Generation | | Dataset (including any stated split) | IFS-REL | | Metric | Indexing Time (mins) | | Unit | TIME | | Direction | Lower is better | | Results loaded | 11 of 11 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Indexing Time (mins)](): Lower is better; unit: TIME. - [Querying Time (mins)](): Lower is better; unit: TIME. - [Input Token Cost (per query)](): Lower is better; unit: SCALAR. - [Output Token Cost (per query)](): Lower is better; unit: SCALAR. ## Recorded results | Method | Indexing Time (mins) | Result date | Report paper | | --- | --- | --- | --- | | NaiveRAG | 2 | Not recorded | 6912c3052828b7cc6937dbc7 | | MIXRAG | 2 | Not recorded | 6912c3052828b7cc6937dbc7 | | L.LLMLingua | 3 | Not recorded | 6912c3052828b7cc6937dbc7 | | G-Retriever | 3 | Not recorded | 6912c3052828b7cc6937dbc7 | | AGRAG | 14 | Not recorded | 6912c3052828b7cc6937dbc7 | | HippoRAG2 | 15 | Not recorded | 6912c3052828b7cc6937dbc7 | | SiReRAG | 18 | Not recorded | 6912c3052828b7cc6937dbc7 | | RAPTOR | 24 | Not recorded | 6912c3052828b7cc6937dbc7 | | F.GraphRAG | 27 | Not recorded | 6912c3052828b7cc6937dbc7 | | LightRAG | 31 | Not recorded | 6912c3052828b7cc6937dbc7 | | GraphRAG | 64 | Not recorded | 6912c3052828b7cc6937dbc7 | ### NaiveRAG Indexing Time (mins): 2. Result ID: 69ba59a047f34ce924a3f9aa. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Category":"Traditional RAG","LLM Backbone":"Qwen2.5-14B-Instruct"}. This record does not assert independent reproduction. ### MIXRAG Indexing Time (mins): 2. Result ID: 69ba59a047f34ce924a3f9af. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Category":"Community-based RAG","LLM Backbone":"Qwen2.5-14B-Instruct"}. This record does not assert independent reproduction. ### L.LLMLingua Indexing Time (mins): 3. Result ID: 69ba59a047f34ce924a3f9ab. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Category":"Traditional RAG","LLM Backbone":"Qwen2.5-14B-Instruct"}. This record does not assert independent reproduction. ### G-Retriever Indexing Time (mins): 3. Result ID: 69ba59a047f34ce924a3f9ae. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Category":"Community-based RAG","LLM Backbone":"Qwen2.5-14B-Instruct"}. This record does not assert independent reproduction. ### AGRAG Indexing Time (mins): 14. Result ID: 69ba59a047f34ce924a3f9b4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Category":"Walking-based RAG","LLM Backbone":"Qwen2.5-14B-Instruct"}. This record does not assert independent reproduction. ### HippoRAG2 Indexing Time (mins): 15. Result ID: 69ba59a047f34ce924a3f9b2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Category":"Walking-based RAG","LLM Backbone":"Qwen2.5-14B-Instruct"}. This record does not assert independent reproduction. ### SiReRAG Indexing Time (mins): 18. Result ID: 69ba59a047f34ce924a3f9ad. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Category":"Tree-based RAG","LLM Backbone":"Qwen2.5-14B-Instruct"}. This record does not assert independent reproduction. ### RAPTOR Indexing Time (mins): 24. Result ID: 69ba59a047f34ce924a3f9ac. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Category":"Tree-based RAG","LLM Backbone":"Qwen2.5-14B-Instruct"}. This record does not assert independent reproduction. ### F.GraphRAG Indexing Time (mins): 27. Result ID: 69ba59a047f34ce924a3f9b3. [Reporting paper]() Recorded evaluation configuration: {"Category":"Walking-based RAG","LLM Backbone":"Qwen2.5-14B-Instruct"}. This record does not assert independent reproduction. ### LightRAG Indexing Time (mins): 31. Result ID: 69ba59a047f34ce924a3f9b1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Category":"Community-based RAG","LLM Backbone":"Qwen2.5-14B-Instruct"}. This record does not assert independent reproduction. ### GraphRAG Indexing Time (mins): 64. Result ID: 69ba59a047f34ce924a3f9b0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Category":"Community-based RAG","LLM Backbone":"Qwen2.5-14B-Instruct"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.