Query-based single-document summarization on SQuALITY
15.82ROUGE-2 PrecisionCommunity-GraphRAG (Local)
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Community-GraphRAG (Local)Base LLM=Llama 3.1-8B2025.02 | 15.82 | 8.64 | 10.1 | 83.93 | 85.84 | 84.66 | |
| IntegrationBase LLM=Llama 3.1-8B2025.02 | 15.69 | 9.32 | 10.67 | 74.56 | 81.22 | 77.73 | |
| RAGBase LLM=Llama 3.1-8B2025.02 | 15.09 | 8.74 | 10.08 | 74.54 | 81 | 77.62 | |
| HippoRAG2Base LLM=Llama 3.1-8B2025.02 | 15.07 | 8.95 | 10.2 | 74.6 | 81.24 | 77.75 | |
| KG-GraphRAG (Triplets+Text)Base LLM=Llama 3.1-8B2025.02 | 15 | 9.48 | 10.52 | 84.37 | 85.88 | 84.92 | |
| RaptorRAGBase LLM=Llama 3.1-8B2025.02 | 14.88 | 8.42 | 9.81 | 74.55 | 81.2 | 77.71 | |
| KG-GraphRAG (Triplets only)Base LLM=Llama 3.1-8B2025.02 | 11.99 | 6.16 | 7.41 | 82.46 | 84.3 | 83.17 | |
| Community-GraphRAG (Global)Base LLM=Llama 3.1-8B2025.02 | 10.23 | 6.21 | 6.99 | 82.68 | 84.26 | 83.3 |