Multi-hop Question Answering on HotpotQA fixed (test)
57.81EMGraph-AdaptR1
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Graph-AdaptR1Backbone=Qwen2.5-7B-Instruct, Interaction Type=Training, Knowledge Representation=Graph-based2026.05 | 57.81 | 64.39 | |
| Graph-R1Backbone=Qwen2.5-7B-Instruct, Interaction Type=Training, Knowledge Representation=Graph-based2026.05 | 55.47 | 63.55 | |
| Search-AdaptR1Backbone=Qwen2.5-7B-Instruct, Interaction Type=Training, Knowledge Representation=Chunk-based2026.05 | 47.66 | 53.68 | |
| Search-R1Backbone=Qwen2.5-7B-Instruct, Interaction Type=Training, Knowledge Representation=Chunk-based2026.05 | 43.77 | 51.26 | |
| R1-SearcherBackbone=Qwen2.5-7B-Instruct, Interaction Type=Training, Knowledge Representation=Chunk-based2026.05 | 39.84 | 46.36 | |
| StandardRAGBackbone=GPT-4o-mini, Interaction Type=Prompt Engineering, Knowledge Representation=Chunk-based2026.05 | 35.16 | 46.7 | |
| R1Backbone=Qwen2.5-7B-Instruct, Interaction Type=Training, Knowledge Representation=None2026.05 | 31.25 | 37.05 | |
| HyperGraphRAGBackbone=GPT-4o-mini, Interaction Type=Prompt Engineering, Knowledge Representation=Graph-based2026.05 | 21.88 | 37.46 | |
| GraphRAGBackbone=GPT-4o-mini, Interaction Type=Prompt Engineering, Knowledge Representation=Graph-based2026.05 | 19.53 | 31.67 | |
| HippoRAG2Backbone=GPT-4o-mini, Interaction Type=Prompt Engineering, Knowledge Representation=Graph-based2026.05 | 19.53 | 31.78 | |
| SFTBackbone=Qwen2.5-7B-Instruct, Interaction Type=Training, Knowledge Representation=Chunk-based2026.05 | 19.53 | 27.59 | |
| NaiveGenerationBackbone=GPT-4o-mini, Interaction Type=Prompt Engineering, Knowledge Representation=None2026.05 | 18.75 | 31.79 | |
| LightRAGBackbone=GPT-4o-mini, Interaction Type=Prompt Engineering, Knowledge Representation=Graph-based2026.05 | 18.75 | 30.7 | |
| PathRAGBackbone=GPT-4o-mini, Interaction Type=Prompt Engineering, Knowledge Representation=Graph-based2026.05 | 10.94 | 23.12 | |
| StandardRAGBackbone=Qwen2.5-7B-Instruct, Interaction Type=Prompt Engineering, Knowledge Representation=Chunk-based2026.05 | 10.16 | 21.1 | |
| NaiveGenerationBackbone=Qwen2.5-7B-Instruct, Interaction Type=Prompt Engineering, Knowledge Representation=None2026.05 | 6.25 | 18.58 |