Knowledge Graph Retrieval on STaRK-Amazon 1.0 (Human)
61.73Hits@1KAR
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| KARCategory=Query Expansion2026.02 | 61.73 | 72.84 | 66.32 | |
| AvaTaRCategory=Agentic2026.02 | 58.32 | 76.54 | 65.91 | |
| RARCategory=Query Expansion2026.02 | 55.56 | 71.6 | 62.15 | |
| AGRCategory=Query Expansion2026.02 | 55.56 | 71.6 | 63.54 | |
| KARCategory=Query Expansion2026.02 | 51.2 | 58.3 | 54.2 | |
| ReflexCategory=Agentic2026.02 | 49.38 | 64.19 | 52.91 | |
| m-adaCategory=Dense2026.02 | 46.91 | 72.84 | 58.74 | |
| HyDeCategory=Query Expansion2026.02 | 45.68 | 72.84 | 57.56 | |
| ReACTCategory=Agentic2026.02 | 45.65 | 71.73 | 58.81 | |
| A+G+ECategory=Ours, Composition=SPARK+SAGE+Edge2026.02 | 45.1 | 55.6 | 48.9 | |
| SPARKCategory=Ours2026.02 | 44.4 | 54.8 | 49.4 | |
| A+G-ECategory=Ours, Composition=SPARK+SAGE-Edge2026.02 | 43.2 | 58.7 | 49.4 | |
| ada-002Category=Dense2026.02 | 39.5 | 64.19 | 52.65 | |
| RARCategory=Query Expansion2026.02 | 38.1 | 45.24 | 42.04 | |
| HyDeCategory=Query Expansion2026.02 | 33.33 | 44.05 | 38.95 | |
| AGRCategory=Query Expansion2026.02 | 33.33 | 44.05 | 38.95 | |
| AvaTaRCategory=Agentic2026.02 | 33.33 | 42.86 | 38.62 | |
| D+BCategory=Hybrid2026.02 | 32.14 | 44.05 | 38.46 | |
| BM25Category=Sparse2026.02 | 32.14 | 41.67 | 37.42 | |
| D+BCategory=Hybrid2026.02 | 32.14 | 44.05 | 38.46 | |
| ada-002Category=Dense2026.02 | 28.57 | 41.67 | 35.81 | |
| ReflexCategory=Agentic2026.02 | 28.57 | 39.29 | 36.53 | |
| A+G-ECategory=Ours, Composition=SPARK+SAGE-Edge2026.02 | 28.41 | 63.84 | 42.48 | |
| ReACTCategory=Agentic2026.02 | 27.27 | 40 | 33.94 | |
| BM25Category=Sparse2026.02 | 27.16 | 51.85 | 18.79 | |
| A+G+ECategory=Ours, Composition=SPARK+SAGE+Edge2026.02 | 25.18 | 55.13 | 37.75 | |
| m-adaCategory=Dense2026.02 | 23.81 | 41.67 | 31.43 | |
| QAGNNCategory=Structural2026.02 | 22.22 | 49.38 | 31.33 | |
| SPARKCategory=Ours2026.02 | 22.22 | 58.03 | 39.93 | |
| QAGNNCategory=Structural2026.02 | 20.24 | 26.19 | 25.53 | |
| DPRCategory=Dense2026.02 | 16.05 | 39.51 | 27.21 | |
| DPRCategory=Dense2026.02 | 4.72 | 9.52 | 7.9 |