Single-hop knowledge graph retrieval on STaRK-Prime (test)
29.7Hits@1GAT
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| GATGNN=GAT, Context=PCST, LLM Backbone=Llama 3.1 8B2026.05 | 29.7 | 33.5 | 24.3 | 31.3 | |
| GINGNN=GIN, Context=PCST, LLM Backbone=Llama 3.1 8B2026.05 | 29.2 | 33.6 | 23.9 | 31 | |
| GCNGNN=GCN, Context=PCST, LLM Backbone=Llama 3.1 8B2026.05 | 29.1 | 33.1 | 23.9 | 30.8 | |
| M-GNANGNN=M-GNAN, Context=PCST + Top-25, LLM Backbone=Llama 3.1 8B2026.05 | 28.9 | 33.2 | 23.7 | 30.7 | |
| M-GNANGNN=M-GNAN, Context=PCST, LLM Backbone=Llama 3.1 8B2026.05 | 28.5 | 33.5 | 23.6 | 30.6 | |
| M-GNANGNN=M-GNAN, Context=Top-25 only, LLM Backbone=Llama 3.1 8B2026.05 | 25.7 | 30.6 | 22 | 27.9 |