Question Answering on MusiqueQA
26.933AccuracyVGraphRAG
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| VGraphRAG2025.03 | 26.933 | 40.026 | |
| RAPTORLLM=Llama-3-8B, Embedding model=BGE-M3, top-k=4, chunk size=1,200-token, Clustering method=K-means2025.03 | 24.133 | 35.595 | |
| RAPTOR2025.03 | 24.133 | 35.595 | |
| KGPLLM=Llama-3-8B, Embedding model=BGE-M3, top-k=4, chunk size=1,200-token2025.03 | 17.333 | 27.572 | |
| VanillaRAGLLM=Llama-3-8B, Embedding model=BGE-M3, top-k=4, chunk size=1,200-token2025.03 | 17.233 | 27.874 | |
| HippoRAGLLM=Llama-3-8B, Embedding model=BGE-M3, top-k=4, chunk size=1,200-token2025.03 | 17 | 28.117 | |
| FastGraphRAGLLM=Llama-3-8B, Embedding model=BGE-M3, top-k=4, chunk size=1,200-token2025.03 | 13.633 | 24.47 | |
| LGraphRAGLLM=Llama-3-8B, Embedding model=BGE-M3, top-k=4, chunk size=1,200-token2025.03 | 12.467 | 23.996 | |
| LGraphRAG2025.03 | 12.467 | 23.996 | |
| DALKLLM=Llama-3-8B, Embedding model=BGE-M3, top-k=4, chunk size=1,200-token2025.03 | 11.367 | 22.484 | |
| HLightRAGLLM=Llama-3-8B, Embedding model=BGE-M3, top-k=4, chunk size=1,200-token2025.03 | 11 | 21.143 | |
| LLightRAGLLM=Llama-3-8B, Embedding model=BGE-M3, top-k=4, chunk size=1,200-token2025.03 | 9.667 | 19.81 | |
| ToGLLM=Llama-3-8B, Embedding model=BGE-M3, top-k=4, chunk size=1,200-token2025.03 | 9.367 | 20.536 | |
| GLightRAGLLM=Llama-3-8B, Embedding model=BGE-M3, top-k=4, chunk size=1,200-token2025.03 | 7.267 | 17.204 | |
| G-retrieverLLM=Llama-3-8B, Embedding model=BGE-M3, top-k=4, chunk size=1,200-token2025.03 | 2.733 | 11.662 | |
| ZeroShotLLM=Llama-3-8B2025.03 | 1.833 | 5.072 |