Sentence-level Retrieval on ReQA NQ (test)
65.5MRRMrRank
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| MrRankType=Hybrid, Components=SGPT 5.8B + BM252024.06 | 65.5 | 52.9 | 81.6 | 86.2 | |
| SGPT 5.8BType=Single2024.06 | 65.2 | 52.8 | 80.7 | 85.6 | |
| MrRankType=Hybrid, Components=MPNETqa + BM252024.06 | 64.2 | 45.7 | 90.8 | 95.1 | |
| RoutingType=Hybrid, Components=MPNETqa + BM252024.06 | 63.8 | 46.7 | 87.3 | 93.1 | |
| MPNETqaType=Single2024.06 | 62.8 | 43.9 | 90.2 | 95 | |
| RRFType=Hybrid, Components=MPNETqa + BM252024.06 | 61.7 | 44.9 | 84.3 | 89.7 | |
| RRFType=Hybrid, Components=USEqa + BM252024.06 | 60.3 | 45 | 80.2 | 87.4 | |
| RRFType=Hybrid, Components=SGPT 5.8B + BM252024.06 | 60.1 | 44.3 | 79.1 | 87.2 | |
| RoutingType=Hybrid, Components=SGPT 5.8B + BM252024.06 | 60 | 44 | 81.3 | 87.6 | |
| MrRankType=Hybrid, Components=USEqa + BM252024.06 | 59 | 45.2 | 76.5 | 83.2 | |
| USEqaType=Single2024.06 | 58.2 | 44.7 | 75.1 | 82.6 | |
| RoutingType=Hybrid, Components=USEqa + BM252024.06 | 55.2 | 39.6 | 75.8 | 83.1 | |
| BM25Type=Single2024.06 | 52.9 | 37.8 | 72.3 | 79.7 |