Information Retrieval on STaRK AMAZON human-generated (test)
61.7Hit@1KAR
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| KAR2025.05 | 61.7 | 72.8 | 66.3 | |
| 4StepFocus2025.05 | 60.5 | 67.9 | 64.3 | |
| AvaTaR2025.05 | 58.3 | 76.5 | 65.9 | |
| AF-Retriever2025.05 | 58 | 69.1 | 63.5 | |
| VSS + Reranker2025.05 | 54.3 | 72.8 | 62.7 | |
| Reflexion2025.05 | 49.4 | 64.2 | 59 | |
| VSSembedding_model=Multi-ada-0022025.05 | 46.9 | 72.8 | 58.7 | |
| ReAct2025.05 | 45.6 | 71.7 | 58.8 | |
| VSSembedding_model=Ada-0022025.05 | 39.5 | 64.2 | 52.6 | |
| DPR2025.05 | 16 | 39.5 | 27.2 |