Question Answering on FairytaleQA (test)
89.26Overall AccuracyLightRAG
Evaluation results
| Method | Links | ||
|---|---|---|---|
| LightRAGBackbone=GPT-5.52026.06 | 89.26 | 92.14 | |
| NKWBackbone=GPT-5.52026.06 | 88.45 | 94.12 | |
| LightRAGBackbone=Qwen3-235B2026.06 | 87.52 | 93.34 | |
| NKWBackbone=Qwen3-235B2026.06 | 87.52 | 95.45 | |
| HippoRAGBackbone=GPT-5.52026.06 | 87.13 | 88.59 | |
| NKWBackbone=Llama-3.1-405B2026.06 | 86.54 | 92.15 | |
| LightRAGBackbone=Llama-3.1-405B2026.06 | 86.15 | 89.4 | |
| LightRAGBackbone=Qwen3-30B2026.06 | 85.63 | 92.41 | |
| HippoRAGBackbone=Llama-3.1-405B2026.06 | 85.43 | 86.98 | |
| NKWBackbone=Qwen3-30B2026.06 | 85.15 | 94.52 | |
| Hybrid RAGBackbone=Llama-3.1-405B2026.06 | 84.85 | 84.26 | |
| Hybrid RAGBackbone=Qwen3-235B2026.06 | 84.06 | 85.02 | |
| Hybrid RAGBackbone=GPT-5.52026.06 | 83.94 | 85.52 | |
| HippoRAGBackbone=Qwen3-235B2026.06 | 82.56 | 83.93 | |
| NKWBackbone=Llama-3.1-70B2026.06 | 81.85 | 86.12 | |
| Hybrid RAGBackbone=Llama-3.1-70B2026.06 | 81.29 | 82.45 | |
| Hybrid RAGBackbone=Qwen3-30B2026.06 | 81.15 | 82.39 | |
| LightRAGBackbone=Llama-3.1-70B2026.06 | 80.15 | 83.43 | |
| HippoRAGBackbone=Qwen3-30B2026.06 | 80.12 | 81.24 | |
| HippoRAGBackbone=Llama-3.1-70B2026.06 | 79.56 | 80.42 | |
| HippoRAGBackbone=Qwen3-8B2026.06 | 77.08 | 81.31 | |
| Hybrid RAGBackbone=Qwen3-8B2026.06 | 73.24 | 74.57 | |
| Hybrid RAGBackbone=Llama-3.1-8B2026.06 | 72.16 | 73.14 | |
| LightRAGBackbone=Llama-3.1-8B2026.06 | 71.55 | 77.23 | |
| HippoRAGBackbone=Llama-3.1-8B2026.06 | 70.82 | 71.97 | |
| NKWBackbone=Llama-3.1-8B2026.06 | 68.42 | 75.14 | |
| LightRAGBackbone=Qwen3-8B2026.06 | 67.92 | 82.29 | |
| A-RAGBackbone=GPT-5.52026.06 | 67.25 | 78.5 | |
| NKWBackbone=Qwen3-8B2026.06 | 65.25 | 80.15 | |
| A-RAGBackbone=Llama-3.1-405B2026.06 | 64.21 | 74.56 | |
| A-RAGBackbone=Qwen3-235B2026.06 | 58.71 | 70.29 | |
| GraphRAGBackbone=GPT-5.52026.06 | 58.47 | 64.2 | |
| A-RAGBackbone=Llama-3.1-70B2026.06 | 55.27 | 66.84 | |
| GraphRAGBackbone=Llama-3.1-405B2026.06 | 55.22 | 61.49 | |
| A-RAGBackbone=Qwen3-30B2026.06 | 46.99 | 53.02 | |
| GraphRAGBackbone=Llama-3.1-70B2026.06 | 46.35 | 54.1 | |
| GraphRAGBackbone=Qwen3-235B2026.06 | 44.87 | 52.54 | |
| A-RAGBackbone=Llama-3.1-8B2026.06 | 42.5 | 52.11 | |
| GraphRAGBackbone=Qwen3-30B2026.06 | 39.53 | 46.26 | |
| A-RAGBackbone=Qwen3-8B2026.06 | 38.73 | 47.26 | |
| GraphRAGBackbone=Llama-3.1-8B2026.06 | 33.4 | 38.98 | |
| GraphRAGBackbone=Qwen3-8B2026.06 | 31.21 | 36.5 |