Retrieval on STARK AMAZON
0.319Hit@1SeedER
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| SeedERLanguage Model Encoder=MiniLM-L6-v22026.05 | 0.319 | 0.546 | 0.422 | 0.444 | |
| Dense RetrieverLanguage Model Encoder=MiniLM-L6-v22026.05 | 0.306 | 0.525 | 0.411 | 0.417 | |
| G-RetrieverLanguage Model Encoder=MiniLM-L6-v22026.05 | 0.306 | 0.526 | 0.408 | 0.416 | |
| SubgraphRAGLanguage Model Encoder=MiniLM-L6-v22026.05 | 0.306 | 0.525 | 0.408 | 0.414 | |
| Beam SearchLanguage Model Encoder=MiniLM-L6-v22026.05 | 0.306 | 0.528 | 0.404 | 0.429 | |
| A⋆ SearchLanguage Model Encoder=MiniLM-L6-v22026.05 | 0.306 | 0.529 | 0.404 | 0.43 | |
| K-hop-w-filterLanguage Model Encoder=MiniLM-L6-v22026.05 | 0.306 | 0.525 | 0.411 | 0.435 | |
| PPRLanguage Model Encoder=MiniLM-L6-v22026.05 | 0.28 | 0.524 | 0.391 | 0.435 | |
| PPR+MMRLanguage Model Encoder=MiniLM-L6-v22026.05 | 0.278 | 0.524 | 0.392 | 0.43 |