Knowledge Graph Retrieval on STaRK PRIME synthetic (test)
51.39Hit@1GraphFlow
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GraphFlowCategory=Requires training on target graph, Approach Type=Agent-based2026.01 | 51.39 | 79.71 | 61.37 | |
| ARKCategory=Training-free, Approach Type=Agent-based2026.01 | 48.2 | 69.46 | 57.68 | |
| mFARCategory=Requires training on target graph, Approach Type=Retrieval-based2026.01 | 40 | 72.6 | 52 | |
| MoRCategory=Requires training on target graph, Approach Type=Retrieval-based2026.01 | 36.41 | 63.48 | 46.92 | |
| ARK + GPT-4oCategory=Training-free, Approach Type=Agent-based, Backbone=GPT-4o2026.01 | 36.01 | 60.13 | 46.44 | |
| ARK distilledCategory=Requires training on target graph, Approach Type=Agent-based, Backbone=Qwen3-8B2026.01 | 31.87 | 57.22 | 41.08 | |
| KARCategory=Training-free, Approach Type=Retrieval-based2026.01 | 30.35 | 50.81 | 39.22 | |
| Think-on-Graph + LLaMA3Category=Training-free, Approach Type=Agent-based, Backbone=LLaMA32026.01 | 21.92 | 33.84 | 26.61 | |
| AvaTaRCategory=Requires training on target graph, Approach Type=Agent-based2026.01 | 18.4 | 39.3 | 26.73 | |
| Think-on-Graph + GPT-4oCategory=Training-free, Approach Type=Agent-based, Backbone=GPT-4o2026.01 | 16.67 | 54.35 | 27.02 | |
| GritLM-7BCategory=Training-free, Approach Type=Retrieval-based2026.01 | 15.57 | 39.09 | 24.11 | |
| BM25Category=Training-free, Approach Type=Retrieval-based2026.01 | 12.75 | 31.25 | 19.84 | |
| ada-002Category=Training-free, Approach Type=Retrieval-based2026.01 | 12.63 | 36 | 21.41 |