Multi-hop Question Answering on ConcurrentQA (test)
50.5EMRelink
Evaluation results
| Method | Links | ||
|---|---|---|---|
| RelinkMethod Type=Proposed, Backbone LLM=deepseek-v3-03242026.01 | 50.5 | 59.6 | |
| HippoRAGMethod Type=Hybrid, Backbone LLM=deepseek-v3-03242026.01 | 45.8 | 53.6 | |
| RAPTORMethod Type=Text-based, Backbone LLM=deepseek-v3-03242026.01 | 40 | 47.6 | |
| GraphRAGMethod Type=Hybrid, Backbone LLM=deepseek-v3-03242026.01 | 39.8 | 47.5 | |
| Vanilla RAGMethod Type=Text-based, Backbone LLM=deepseek-v3-03242026.01 | 31 | 38.9 | |
| LightRAGMethod Type=Hybrid, Backbone LLM=deepseek-v3-03242026.01 | 30.8 | 38.9 | |
| ToGMethod Type=Graph-based, Backbone LLM=deepseek-v3-03242026.01 | 16.6 | 18.5 | |
| G-RetrieverMethod Type=Graph-based, Backbone LLM=deepseek-v3-03242026.01 | 16.2 | 20.9 | |
| Deepseek-v3Method Type=LLM only, Backbone LLM=deepseek-v3-03242026.01 | 11.4 | 17 | |
| GPT-4oMethod Type=LLM only, Backbone LLM=gpt-4o-2024-07-062026.01 | 8.6 | 15.8 |