Multi-hop Retrieval on STaRK-Prime multi-hop (test)
34.1Hits@1GIN
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| GINGNN=Black-box baseline, Context=PCST2026.05 | 34.1 | 38.7 | 29.1 | 36.1 | |
| M-GNANGNN=Auditable (Ours), Context=PCST2026.05 | 29.3 | 33.7 | 23.9 | 31.2 | |
| GCNGNN=Black-box baseline, Context=PCST2026.05 | 29.1 | 33.1 | 23.5 | 30.9 | |
| M-GNANGNN=Auditable (Ours), Context=PCST + Top-252026.05 | 28.3 | 33 | 23.4 | 30.3 | |
| GATGNN=Black-box baseline, Context=PCST2026.05 | 28.2 | 33.1 | 23.1 | 30.2 | |
| M-GNANGNN=Auditable (Ours), Context=Top-25 only2026.05 | 21.2 | 25.3 | 17.5 | 22.9 |