First-stage Retrieval on BRIGHT (test)
54.5nDCG@10 (Biology)Reason-Embed-4B
Evaluation results
| Method | Links | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Reason-Embed-4BFusion Category=Individual Retrievers2025.09 | 54.5 | 54 | 34.4 | 46.1 | 34.6 | 35.9 | 37 | 42.4 | 37.1 | 12 | 24.6 | 11.3 | 40.7 | 45.5 | 32.5 | 36.9 | |
| Reason-Embed-4BFusion Category=RRF with BM25Q2025.09 | 52.8 | 53 | 31.2 | 43.8 | 28 | 29.4 | 31 | 38.4 | 38 | 25.6 | 31.8 | 12.5 | 39.9 | 45.5 | 32.6 | 35.9 | |
| Diver-Retriever-4BFusion Category=Individual Retrievers2025.09 | 42.1 | 46.8 | 22.4 | 34.4 | 21.5 | 20.9 | 25.1 | 30.4 | 37.8 | 12.9 | 25.4 | 10.3 | 37.7 | 38 | 28.6 | 29.1 | |
| Reason-Embed-4BFusion Category=NAF with BM25Q2025.09 | 38.2 | 48.8 | 26.9 | 34.8 | 27.4 | 33.4 | 28.6 | 34 | 41.9 | 14.7 | 28.3 | 13.1 | 32.1 | 32.9 | 26.1 | 31.1 | |
| Diver-Retriever-4BFusion Category=RRF with BM25Q2025.09 | 35.7 | 46.1 | 27 | 32.9 | 26.2 | 30.1 | 26.5 | 32.1 | 40.6 | 14.8 | 27.7 | 12.9 | 25.5 | 24.2 | 20.9 | 28.5 | |
| Diver-Retriever-4BFusion Category=NAF with BM25Q2025.09 | 34.6 | 45.1 | 21.7 | 28.7 | 21.2 | 25.8 | 23.2 | 28.6 | 39.3 | 15.1 | 27.2 | 12.3 | 30.1 | 29 | 23.8 | 27.2 | |
| SPLADE-v3Fusion Category=NAF with BM25Q2025.09 | 23.7 | 30.9 | 16.5 | 16.5 | 15.7 | 18.6 | 16.4 | 19.8 | 28.8 | 15.5 | 22.1 | 8.6 | 11.9 | 7.3 | 9.3 | 17.5 | |
| SPLADE-v3Fusion Category=RRF with BM25Q2025.09 | 22 | 29.9 | 17 | 15.8 | 17 | 17.5 | 15.2 | 19.2 | 28.2 | 16.3 | 22.3 | 8.3 | 11.1 | 7.7 | 9 | 17.2 | |
| SPLADE-v3Fusion Category=Individual Retrievers2025.09 | 21 | 26.7 | 16 | 15.3 | 15.8 | 12.9 | 15 | 17.5 | 26 | 14.4 | 20.2 | 6.9 | 11.1 | 5.5 | 7.9 | 15.6 | |
| BGE-large-en-v1.5Fusion Category=NAF with BM25Q2025.09 | 20.3 | 31.6 | 19.2 | 18.5 | 15.3 | 20.5 | 16.5 | 20.3 | 30.1 | 10.6 | 20.4 | 7.6 | 14.5 | 8.1 | 10.1 | 17.7 | |
| BM25QFusion Category=Individual Retrievers2025.09 | 19.7 | 27.9 | 15.2 | 12.7 | 13.9 | 18.6 | 15.2 | 17.6 | 25 | 7.9 | 16.5 | 6.3 | 10.4 | 4.9 | 7.2 | 14.8 | |
| BGE-large-en-v1.5Fusion Category=RRF with BM25Q2025.09 | 17.5 | 31.2 | 18 | 18.5 | 15.4 | 18.2 | 15.8 | 19.2 | 29.3 | 15.7 | 22.5 | 7 | 12.7 | 8.8 | 9.5 | 17.3 | |
| BGE-large-en-v1.5Fusion Category=Individual Retrievers2025.09 | 12.4 | 25.5 | 16.6 | 18.1 | 12.3 | 11 | 14.4 | 15.7 | 26.7 | 3.4 | 15 | 6.4 | 14.1 | 5.3 | 8.6 | 13.8 |