Evidence-based Retrieval on SQuAD
73.3Hit@20OPQE
Evaluation results
| Method | Links | |
|---|---|---|
| OPQEretriever=Sparse BM25, model_scale=3B2025.10 | 73.3 | |
| OPQEretriever=Sparse BM25, model_scale=7B2025.10 | 73.2 | |
| DRretriever=Sparse BM25, model_scale=7B2025.10 | 72.2 | |
| DRretriever=Sparse BM25, model_scale=3B2025.10 | 72.1 | |
| OPQEretriever=Dense, backbone=E5-base-v2, model_scale=3B2025.10 | 71.4 | |
| Baseretriever=Sparse BM252025.10 | 71.1 | |
| DRretriever=Dense, backbone=E5-base-v2, model_scale=3B2025.10 | 70.3 | |
| Baseretriever=Dense, backbone=E5-base-v22025.10 | 70.2 | |
| DRretriever=Dense, backbone=E5-base-v2, model_scale=7B2025.10 | 70.2 | |
| OPQEretriever=Dense, backbone=E5-base-v2, model_scale=7B2025.10 | 70.1 | |
| SPQEretriever=Sparse BM252025.10 | 69.7 | |
| SPQEretriever=Dense, backbone=E5-base-v22025.10 | 68.8 |