Retrieval on STaRK AMAZON (Human)
42.43Recall@20AvaTaR
Evaluation results
| Method | Links | |
|---|---|---|
| AvaTaRCategory=Finetuned2026.02 | 42.43 | |
| SPARK +SAGE-EdgeCategory=SAGE (Ours)2026.02 | 42.05 | |
| KARCategory=Query Expansion2026.02 | 40.62 | |
| multi-ada-002Category=Dense2026.02 | 40.22 | |
| HyDeCategory=Query Expansion2026.02 | 39.25 | |
| AGRCategory=Query Expansion2026.02 | 37.27 | |
| SPARK +SAGE +EdgeCategory=SAGE (Ours)2026.02 | 36.93 | |
| RARCategory=Query Expansion2026.02 | 36.15 | |
| ReACTCategory=Agentic2026.02 | 35.95 | |
| ReflexionCategory=Agentic2026.02 | 35.95 | |
| ada-002Category=Dense2026.02 | 35.46 | |
| SPARKCategory=SAGE (Ours)2026.02 | 33.56 | |
| Dense+BM25Category=Hybrid2026.02 | 24.3 | |
| QAGNNCategory=Structural2026.02 | 21.54 | |
| DPRCategory=Dense2026.02 | 15.23 | |
| BM25Category=Sparse2026.02 | 15.23 |