Retrieval on STaRK MAG Synthetic
78.8Recall@20FocusedR.
Evaluation results
| Method | Links | |
|---|---|---|
| FocusedR.Category=Hybrid2026.02 | 78.8 | |
| MoRCategory=Finetuned2026.02 | 75 | |
| mFARCategory=Finetuned2026.02 | 71.7 | |
| SPARK +SAGE-EdgeCategory=SAGE (Ours)2026.02 | 70.1 | |
| SPARK +SAGE +EdgeCategory=SAGE (Ours)2026.02 | 68.6 | |
| SPARKCategory=SAGE (Ours)2026.02 | 66.4 | |
| 4StepFocusCategory=Hybrid2026.02 | 65.8 | |
| KARCategory=Query Expansion2026.02 | 60.28 | |
| AGRCategory=Query Expansion2026.02 | 51.89 | |
| Dense+BM25Category=Hybrid2026.02 | 51.49 | |
| RARCategory=Query Expansion2026.02 | 50.87 | |
| multi-ada-002Category=Dense2026.02 | 50.8 | |
| HyDeCategory=Query Expansion2026.02 | 50.02 | |
| AvaTaRCategory=Finetuned2026.02 | 49.7 | |
| ReflexionCategory=Agentic2026.02 | 49.55 | |
| ada-002Category=Dense2026.02 | 48.36 | |
| ReACTCategory=Agentic2026.02 | 47.03 | |
| QAGNNCategory=Structural2026.02 | 46.97 | |
| BM25Category=Sparse2026.02 | 45.69 | |
| DPRCategory=Dense2026.02 | 42.11 |