Retrieval on STARK MAG
24.4Hit Rate @ 1SeedER
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| SeedERLanguage Model Encoder=MiniLM-L6-v22026.05 | 24.4 | 43.9 | 33.2 | 44.9 | |
| G-RetrieverLanguage Model Encoder=MiniLM-L6-v22026.05 | 20.6 | 37.1 | 27.7 | 36.6 | |
| K-hop-w-filterLanguage Model Encoder=MiniLM-L6-v22026.05 | 20.5 | 39.1 | 28.5 | 39.8 | |
| Beam SearchLanguage Model Encoder=MiniLM-L6-v22026.05 | 20.4 | 38.7 | 28.1 | 39.2 | |
| A⋆ SearchLanguage Model Encoder=MiniLM-L6-v22026.05 | 20.4 | 38.7 | 28.2 | 39.2 | |
| Dense RetrieverLanguage Model Encoder=MiniLM-L6-v22026.05 | 20.3 | 35.8 | 27.3 | 34.4 | |
| SubgraphRAGLanguage Model Encoder=MiniLM-L6-v22026.05 | 20.3 | 35.9 | 27.3 | 34.5 | |
| PPRLanguage Model Encoder=MiniLM-L6-v22026.05 | 19.1 | 39.5 | 27.9 | 40.4 | |
| PPR+MMRLanguage Model Encoder=MiniLM-L6-v22026.05 | 19.1 | 39.7 | 27.9 | 39.9 |