Knowledge Graph Retrieval on STARK MAG
39.7Hits@1SeedER
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| SeedERtext encoder=Qwen3-4B-Embedding2026.05 | 39.7 | 62 | 49.5 | 60.7 | |
| GraphFlowreranking=true2026.05 | 39.1 | 57.5 | 47.8 | 57.2 | |
| GraphFlowreranking=false2026.05 | 29.3 | 58.6 | 41.3 | 57.2 | |
| SFTreranking=true2026.05 | 27.6 | 44.9 | 36.4 | 37.5 | |
| PRMreranking=true2026.05 | 27.3 | 44.1 | 33.7 | 36.7 | |
| ToG + GPT-4oreranking=true2026.05 | 26.7 | 56.7 | 39.7 | 48 | |
| SFTreranking=false2026.05 | 26.5 | 28.6 | 29.1 | 37.5 | |
| PRMreranking=false2026.05 | 26.1 | 28 | 28.5 | 36.7 | |
| ToG + GPT-4oreranking=false2026.05 | 23.3 | 56.7 | 36.4 | 48 | |
| ToG + LLaMA3reranking=false2026.05 | 12 | 14.1 | 12.7 | 6.8 | |
| ToG + LLaMA3reranking=true2026.05 | 12 | 14.1 | 12.7 | 6.8 |