Knowledge Graph Retrieval on STaRK-Amazon Synthetic 1.0
64Hits@1FocusR
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| FocusRCategory=Hybrid2026.02 | 64 | 76.2 | 69.3 | |
| MoRCategory=Finetuned2026.02 | 52.2 | 74.6 | 62.2 | |
| KARCategory=Query Expansion2026.02 | 50.47 | 65.37 | 57.51 | |
| AvaTaRCategory=Agentic2026.02 | 49.97 | 69.16 | 52.01 | |
| 4StepCategory=Hybrid2026.02 | 47.6 | 67.6 | 56.5 | |
| ReflexCategory=Agentic2026.02 | 42.79 | 65.05 | 52.91 | |
| ReACTCategory=Agentic2026.02 | 42.14 | 64.56 | 52.3 | |
| mFARCategory=Finetuned2026.02 | 41.2 | 70 | 54.2 | |
| m-adaCategory=Dense2026.02 | 40.07 | 64.98 | 51.55 | |
| AGRCategory=Query Expansion2026.02 | 39.29 | 53.66 | 46.2 | |
| RARCategory=Query Expansion2026.02 | 39.02 | 52.87 | 39.58 | |
| D+BCategory=Hybrid2026.02 | 29.72 | 49.64 | 38.71 | |
| ada-002Category=Dense2026.02 | 29.08 | 49.61 | 38.62 | |
| HyDeCategory=Query Expansion2026.02 | 28.98 | 50.1 | 39.58 | |
| A+G-ECategory=Ours, Composition=SPARK+SAGE-Edge2026.02 | 28.41 | 55.13 | 42.48 | |
| SPARKCategory=Ours2026.02 | 26.72 | 54.27 | 36.24 | |
| BM25Category=Sparse2026.02 | 25.85 | 45.25 | 34.91 | |
| A+G+ECategory=Ours, Composition=SPARK+SAGE+Edge2026.02 | 25.18 | 53.45 | 36.18 | |
| DPRCategory=Dense2026.02 | 15.29 | 47.93 | 30.2 | |
| QAGNNCategory=Structural2026.02 | 12.88 | 39.01 | 29.12 |