Sentence-level retrieval on ReQA SQuAD (test)
0.815MRRMrRank
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| MrRankType=Hybrid, Components=SGPT 5.8B + BM252024.06 | 0.815 | 73.6 | 91.3 | 94.5 | |
| SGPT 5.8BType=Single2024.06 | 0.783 | 69.9 | 88.7 | 92.6 | |
| RoutingType=Hybrid, Components=SGPT 5.8B + BM252024.06 | 0.762 | 68.6 | 85.2 | 89.7 | |
| RRFType=Hybrid, Components=SGPT 5.8B + BM252024.06 | 0.754 | 66.4 | 86.4 | 91.4 | |
| MrRankType=Hybrid, Components=USEqa + BM252024.06 | 0.75 | 66.3 | 86 | 90.2 | |
| MrRankType=Hybrid, Components=MPNETqa + BM252024.06 | 0.748 | 65.8 | 85.6 | 90.9 | |
| RRFType=Hybrid, Components=USEqa + BM252024.06 | 0.721 | 62.4 | 83.9 | 89.5 | |
| RoutingType=Hybrid, Components=MPNETqa + BM252024.06 | 0.709 | 62.3 | 81.1 | 86.9 | |
| RoutingType=Hybrid, Components=USEqa + BM252024.06 | 0.705 | 62.6 | 79.6 | 85.1 | |
| RRFType=Hybrid, Components=MPNETqa + BM252024.06 | 0.673 | 54.6 | 82.7 | 89.6 | |
| BM25Type=Single2024.06 | 0.67 | 59.1 | 75.9 | 81.4 | |
| USEqaType=Single2024.06 | 0.665 | 56.1 | 79.3 | 85.4 | |
| MPNETqaType=Single2024.06 | 0.549 | 39.9 | 74.8 | 84.7 |