Query-based Multiple Document Summarization on ODSum story
15.56ROUGE-2 PHippoRAG2
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| HippoRAG2Backbone=Llama 3.1-8B2025.02 | 15.56 | 8.43 | 9.82 | 83.7 | 85.71 | 84.46 | |
| RAGBackbone=Llama 3.1-8B2025.02 | 15.39 | 8.44 | 9.81 | 83.87 | 85.74 | 84.57 | |
| IntegrationBackbone=Llama 3.1-8B2025.02 | 14.77 | 8.55 | 9.53 | 83.73 | 85.56 | 84.4 | |
| RaptorRAGBackbone=Llama 3.1-8B2025.02 | 14.69 | 8.47 | 9.62 | 83.87 | 85.76 | 84.58 | |
| Community-GraphRAG (Local)Backbone=Llama 3.1-8B2025.02 | 13.84 | 7.19 | 8.49 | 83.19 | 85.07 | 83.9 | |
| KG-GraphRAG (Triplets only)Backbone=Llama 3.1-8B2025.02 | 11.02 | 5.56 | 6.62 | 82.09 | 83.91 | 82.77 | |
| Community-GraphRAG (Global)Backbone=Llama 3.1-8B2025.02 | 9.4 | 4.47 | 5.46 | 81.46 | 83.54 | 82.3 | |
| KG-GraphRAG (Triplets+Text)Backbone=Llama 3.1-8B2025.02 | 9.19 | 5.82 | 6.22 | 79.39 | 83.3 | 81.03 |