Knowledge Graph Retrieval on STaRK MAG synthetic (test)
73.4Hit@1ARK
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ARKCategory=Training-free, Approach Type=Agent-based2026.01 | 73.4 | 84.47 | 79.87 | |
| ARK + GPT-4oCategory=Training-free, Approach Type=Agent-based, Backbone=GPT-4o2026.01 | 67.01 | 79.79 | 75.46 | |
| ARK distilledCategory=Requires training on target graph, Approach Type=Agent-based, Backbone=Qwen3-8B2026.01 | 61.66 | 81.39 | 70.09 | |
| MoRCategory=Requires training on target graph, Approach Type=Retrieval-based2026.01 | 58.19 | 75.01 | 67.14 | |
| mFARCategory=Requires training on target graph, Approach Type=Retrieval-based2026.01 | 55.9 | 74.1 | 64.3 | |
| KARCategory=Training-free, Approach Type=Retrieval-based2026.01 | 50.47 | 60.28 | 57.51 | |
| AvaTaRCategory=Requires training on target graph, Approach Type=Agent-based2026.01 | 44.36 | 50.63 | 51.15 | |
| GraphFlowCategory=Requires training on target graph, Approach Type=Agent-based2026.01 | 39.09 | 57.18 | 47.82 | |
| GritLM-7BCategory=Training-free, Approach Type=Retrieval-based2026.01 | 37.9 | 46.4 | 47.25 | |
| ada-002Category=Training-free, Approach Type=Retrieval-based2026.01 | 29.08 | 48.36 | 38.62 | |
| BM25Category=Training-free, Approach Type=Retrieval-based2026.01 | 25.85 | 45.69 | 34.91 | |
| Think-on-Graph + GPT-4oCategory=Training-free, Approach Type=Agent-based, Backbone=GPT-4o2026.01 | 23.33 | 48.03 | 36.38 | |
| Think-on-Graph + LLaMA3Category=Training-free, Approach Type=Agent-based, Backbone=LLaMA32026.01 | 12 | 6.77 | 12.67 |