Long narrative understanding QA on NarrativeQA (Acc %)
55AccuracyHGMEM
Evaluation results
| Method | Links | |
|---|---|---|
| HGMEMBase LLM=GPT-4o, Type=Ours, Working Memory=true2025.12 | 55 | |
| ComoRAGBase LLM=GPT-4o, Type=Multi-step RAG, Working Memory=true2025.12 | 54 | |
| GraphRAGBase LLM=GPT-4o, Type=Traditional RAG, Working Memory=false2025.12 | 53 | |
| NaiveRAGBase LLM=GPT-4o, Type=Traditional RAG, Working Memory=false2025.12 | 52 | |
| HGMEMBase LLM=Qwen2.5-32B-Instruct, Type=Ours, Working Memory=true2025.12 | 51 | |
| DeepRAGBase LLM=GPT-4o, Type=Multi-step RAG, Working Memory=true2025.12 | 45 | |
| LightRAGBase LLM=GPT-4o, Type=Traditional RAG, Working Memory=false2025.12 | 44 | |
| GraphRAGBase LLM=Qwen2.5-32B-Instruct, Type=Traditional RAG, Working Memory=false2025.12 | 44 | |
| DeepRAGBase LLM=Qwen2.5-32B-Instruct, Type=Multi-step RAG, Working Memory=true2025.12 | 44 | |
| ComoRAGBase LLM=Qwen2.5-32B-Instruct, Type=Multi-step RAG, Working Memory=true2025.12 | 44 | |
| LightRAGBase LLM=Qwen2.5-32B-Instruct, Type=Traditional RAG, Working Memory=false2025.12 | 40 | |
| NaiveRAGBase LLM=Qwen2.5-32B-Instruct, Type=Traditional RAG, Working Memory=false2025.12 | 37 | |
| HippoRAG v2Base LLM=GPT-4o, Type=Traditional RAG, Working Memory=false2025.12 | 34 | |
| HippoRAG v2Base LLM=Qwen2.5-32B-Instruct, Type=Traditional RAG, Working Memory=false2025.12 | 33 |