Knowledge Graph Retrieval on STaRK-MAG Synthetic 1.0
74.1Hits@1FocusR
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| FocusRCategory=Hybrid2026.02 | 74.1 | 84.2 | 78.8 | |
| MoRCategory=Finetuned2026.02 | 58.2 | 78.3 | 67.1 | |
| 4StepCategory=Hybrid2026.02 | 53.8 | 69.2 | 61.4 | |
| KARCategory=Query Expansion2026.02 | 50.47 | 65.37 | 57.51 | |
| mFARCategory=Finetuned2026.02 | 49 | 69.6 | 58.2 | |
| AvaTaRCategory=Agentic2026.02 | 46.08 | 59.32 | 52.01 | |
| A+G-ECategory=Ours, Composition=SPARK+SAGE-Edge2026.02 | 43.2 | 60 | 49.3 | |
| A+G+ECategory=Ours, Composition=SPARK+SAGE+Edge2026.02 | 41.7 | 57.2 | 48.8 | |
| SPARKCategory=Ours2026.02 | 41 | 56.41 | 49.3 | |
| ReflexCategory=Agentic2026.02 | 40.71 | 54.44 | 47.06 | |
| AGRCategory=Query Expansion2026.02 | 39.29 | 53.66 | 46.2 | |
| RARCategory=Query Expansion2026.02 | 39.02 | 52.87 | 39.58 | |
| ReACTCategory=Agentic2026.02 | 31.07 | 49.49 | 39.25 | |
| D+BCategory=Hybrid2026.02 | 29.72 | 49.64 | 38.71 | |
| ada-002Category=Dense2026.02 | 29.08 | 49.61 | 38.62 | |
| HyDeCategory=Query Expansion2026.02 | 28.98 | 50.1 | 39.58 | |
| m-adaCategory=Dense2026.02 | 25.92 | 50.43 | 36.94 | |
| BM25Category=Sparse2026.02 | 25.85 | 45.25 | 34.91 | |
| QAGNNCategory=Structural2026.02 | 12.88 | 39.01 | 29.12 | |
| DPRCategory=Dense2026.02 | 10.51 | 35.23 | 21.34 |