Knowledge Graph Retrieval on STaRK AMAZON synthetic (test)
0.5582Hit@1ARK
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ARKCategory=Training-free, Approach Type=Agent-based2026.01 | 0.5582 | 0.6061 | 0.6477 | |
| ARK + GPT-4oCategory=Training-free, Approach Type=Agent-based, Backbone=GPT-4o2026.01 | 0.5513 | 0.5718 | 0.6429 | |
| ARK distilledCategory=Requires training on target graph, Approach Type=Agent-based, Backbone=Qwen3-8B2026.01 | 0.5499 | 0.6031 | 0.6424 | |
| KARCategory=Training-free, Approach Type=Retrieval-based2026.01 | 0.542 | 0.5724 | 0.6129 | |
| mFARCategory=Requires training on target graph, Approach Type=Retrieval-based2026.01 | 0.53 | 0.663 | 0.643 | |
| MoRCategory=Requires training on target graph, Approach Type=Retrieval-based2026.01 | 0.5219 | 0.5992 | 0.6224 | |
| AvaTaRCategory=Requires training on target graph, Approach Type=Agent-based2026.01 | 0.499 | 0.606 | 0.587 | |
| GraphFlowCategory=Requires training on target graph, Approach Type=Agent-based2026.01 | 0.4785 | 0.3615 | 0.5549 | |
| BM25Category=Training-free, Approach Type=Retrieval-based2026.01 | 0.4494 | 0.5377 | 0.553 | |
| GritLM-7BCategory=Training-free, Approach Type=Retrieval-based2026.01 | 0.4208 | 0.5652 | 0.5346 | |
| ada-002Category=Training-free, Approach Type=Retrieval-based2026.01 | 0.3916 | 0.5329 | 0.5035 | |
| Think-on-Graph + GPT-4oCategory=Training-free, Approach Type=Agent-based, Backbone=GPT-4o2026.01 | 0.2067 | 0.2581 | 0.309 | |
| Think-on-Graph + LLaMA3Category=Training-free, Approach Type=Agent-based, Backbone=LLaMA32026.01 | 0.0421 | 0.0261 | 0.0525 |