Long-Document Summarization on SQuALITY
35.44BLEU-1QAFD-RAG
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| QAFD-RAGLLM=GPT-4o-mini, Embedding model=text-embedding-3-small (1536d), seed nodes=40, diffusion mass α=50, a=1, b=1/42026.04 | 35.44 | 18.63 | 28.43 | 4.79 | 25.59 | |
| LightRAGLLM=GPT-4o-mini, Embedding model=text-embedding-3-small (1536d)2026.04 | 34.17 | 17.41 | 28.59 | 4.31 | 23.27 | |
| GraphRAGLLM=GPT-4o-mini, Embedding model=text-embedding-3-small (1536d)2026.04 | 33.91 | 16.12 | 26.38 | 4.08 | 24.38 | |
| HippoRAGLLM=GPT-4o-mini, Embedding model=text-embedding-3-small (1536d)2026.04 | 33.22 | 16.74 | 27.29 | 3.92 | 23.41 | |
| RAPTORLLM=GPT-4o-mini, Embedding model=text-embedding-3-small (1536d)2026.04 | 32.1 | 16.58 | 25.13 | 3.49 | 22.87 |