Query-based Multiple Document Summarization on ODSum meeting
15.91ROUGE-2 PrecisionHippoRAG2
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| HippoRAG2Backbone=Llama 3.1-8B2025.02 | 15.91 | 6.09 | 8.51 | 82.43 | 85.55 | 83.95 | |
| IntegrationBackbone=Llama 3.1-8B2025.02 | 15.69 | 6.15 | 8.51 | 82.87 | 85.81 | 84.31 | |
| Community-GraphRAG (Local)Backbone=Llama 3.1-8B2025.02 | 15.65 | 5.66 | 8.02 | 82.44 | 85.54 | 83.96 | |
| RAGBackbone=Llama 3.1-8B2025.02 | 15.5 | 6.43 | 8.77 | 83.12 | 85.84 | 84.45 | |
| RaptorRAGBackbone=Llama 3.1-8B2025.02 | 14.85 | 6.21 | 8.44 | 82.66 | 85.52 | 84.06 | |
| KG-GraphRAG (Triplets+Text)Backbone=Llama 3.1-8B2025.02 | 11.97 | 4.97 | 6.72 | 81.5 | 84.41 | 82.92 | |
| KG-GraphRAG (Triplets only)Backbone=Llama 3.1-8B2025.02 | 11.64 | 4.87 | 6.58 | 81.13 | 84.32 | 82.69 | |
| Community-GraphRAG (Global)Backbone=Llama 3.1-8B2025.02 | 11.44 | 3.89 | 5.59 | 81.2 | 84.5 | 82.81 |