Knowledge Graph Retrieval on Prime (test)
67.8H@1GRASP
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| GRASPCategory=Hybrid, Setting=Supervised2026.05 | 67.8 | 88 | 88.1 | 76.8 | |
| GraphRAFTCategory=Hybrid, Setting=Supervised2026.05 | 63.7 | 75.4 | 76.4 | 69 | |
| GRASP w/o RR f.t.Category=Hybrid, Setting=Zero-shot, reranker=none, fine-tuning=true2026.05 | 60.2 | 81.1 | 84.2 | 69.5 | |
| GRASP w/o RRCategory=Hybrid, Setting=Zero-shot, reranker=none2026.05 | 60.2 | 81.1 | 84.2 | 69.5 | |
| AF-RetrieverCategory=Hybrid, Setting=Zero-shot2026.05 | 46.2 | 63.7 | 51.2 | 54 | |
| GRASP w/o RR & FSCategory=Hybrid, Setting=Zero-shot, reranker=none, fusion=none2026.05 | 43.8 | 58.1 | 62 | 50.3 | |
| mFARCategory=Hybrid, Setting=Supervised2026.05 | 40.9 | 62.8 | 68.3 | 51.2 | |
| mFAR*Category=Hybrid, Setting=Supervised2026.05 | 39 | 62.6 | 67.7 | 49.7 | |
| MoRCategory=Hybrid, Setting=Supervised2026.05 | 36.4 | 60 | 63.5 | 46.9 | |
| KARCategory=Hybrid, Setting=Zero-shot2026.05 | 30.4 | 49.3 | 50.8 | 39.2 | |
| HybGRAGCategory=Hybrid, Setting=Zero-shot2026.05 | 28.6 | 41.4 | 43.6 | 34.5 | |
| AvaTaRCategory=Hybrid, Setting=Supervised2026.05 | 18.4 | 36.7 | 39.3 | 26.7 | |
| multi-ada-002Category=Textual, Setting=Zero-shot2026.05 | 15.1 | 33.6 | 38.1 | 23.5 | |
| BM25Category=Textual, Setting=Zero-shot2026.05 | 12.8 | 27.9 | 31.3 | 19.8 | |
| ada-002Category=Textual, Setting=Zero-shot2026.05 | 12.6 | 31.5 | 36 | 21.4 | |
| Qwen3/SapBERTCategory=Textual, Setting=Zero-shot2026.05 | 9 | 21.3 | 26.7 | 15 | |
| QAGNNCategory=Structural, Setting=Zero-shot2026.05 | 8.9 | 21.4 | 29.6 | 14.7 | |
| ToGCategory=Structural, Setting=Zero-shot2026.05 | 6.1 | 15.7 | 13.1 | 10.2 | |
| DPRCategory=Textual, Setting=Zero-shot2026.05 | 4.5 | 21.9 | 30.1 | 12.4 | |
| MFAR*Category=Hybrid2025.02 | 0.409 | 0.628 | 0.683 | 0.512 | |
| MoRCategory=Hybrid2025.02 | 0.3641 | 0.6001 | 0.6348 | 0.4692 | |
| MoRw/o RCategory=Ablation2025.02 | 0.3159 | 0.5348 | 0.6074 | 0.4181 | |
| KARCategory=Hybrid2025.02 | 0.3035 | 0.493 | 0.5081 | 0.3922 | |
| MoRw/o RTCategory=Ablation2025.02 | 0.2895 | 0.4612 | 0.4954 | 0.3656 | |
| HYBGRAGCategory=Hybrid2025.02 | 0.2856 | 0.4138 | 0.4358 | 0.3449 | |
| MoRw/o RSCategory=Ablation2025.02 | 0.2227 | 0.3845 | 0.3921 | 0.2941 | |
| AvaTaRCategory=Hybrid2025.02 | 0.1844 | 0.3673 | 0.3931 | 0.2673 | |
| Multi-ada-002Category=Textual2025.02 | 0.151 | 0.3356 | 0.3805 | 0.2349 | |
| BM25Category=Textual2025.02 | 0.1275 | 0.2792 | 0.3125 | 0.1984 | |
| Ada-002Category=Textual2025.02 | 0.1263 | 0.3149 | 0.36 | 0.2141 | |
| QAGNNCategory=Structural (KG)2025.02 | 0.0885 | 0.2135 | 0.2963 | 0.1473 | |
| ToGCategory=Structural (KG)2025.02 | 0.0607 | 0.1571 | 0.1307 | 0.1017 | |
| DPRCategory=Textual2025.02 | 0.0446 | 0.2185 | 0.3013 | 0.1238 |