Information Retrieval on BRIGHT static retrieval setting PRO
33.8NDCG@10 (Overall)BGE-Reasoner-8B
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| BGE-Reasoner-8BRetrieval Setting=static, Number of Parameters=8B2026.05 | 33.8 | 73.5 | 74.6 | 66 | 65.5 | 64.7 | 67.7 | 63.8 | 68 | |
| DIVER-4B-1020Retrieval Setting=static, Number of Parameters=4B2026.05 | 30.6 | 72.8 | 72.1 | 61.9 | 59.9 | 56.7 | 63.8 | 58.8 | 63.7 | |
| DIVER-4BRetrieval Setting=static, Number of Parameters=4B2026.05 | 28.9 | 67.3 | 71.2 | 53.4 | 60.4 | 53.1 | 60.3 | 53.7 | 59.9 | |
| RTriever-4BRetrieval Setting=static, Number of Parameters=4B2026.05 | 27.7 | 63.1 | 64.7 | 53.6 | 50.1 | 49.2 | 52.7 | 53.9 | 55.3 | |
| INF-Retriever-ProRetrieval Setting=static, Number of Parameters=7B2026.05 | 26.3 | 62.6 | 64.3 | 50.7 | 51.9 | 46.1 | 50.1 | 50.6 | 53.8 | |
| ReasonIR-8BRetrieval Setting=static, Number of Parameters=8B2026.05 | 24.4 | 42.6 | 52.2 | 34.9 | 35.6 | 40.9 | 45.7 | 35.1 | 41 | |
| Qwen3-8BRetrieval Setting=static, Number of Parameters=8B2026.05 | 23.7 | 52.7 | 58.6 | 46 | 46.6 | 48.4 | 52.8 | 41 | 49.5 | |
| GTE-7BRetrieval Setting=static, Number of Parameters=7B2026.05 | 22.5 | 60.3 | 62.5 | 39.1 | 37.4 | 41.8 | 40 | 37.5 | 45.5 | |
| GritLMRetrieval Setting=static, Number of Parameters=7B2026.05 | 21 | 50.6 | 58.3 | 40.3 | 37.6 | 43.8 | 38.8 | 39.2 | 44.1 | |
| INSTRUCTOR-XLRetrieval Setting=static, Number of Parameters=1.5B2026.05 | 18.9 | 45.1 | 54.6 | 44.2 | 45.9 | 44.5 | 47.5 | 42.3 | 46.3 | |
| EmbeddingGemma-300MRetrieval Setting=static, Number of Parameters=300M2026.05 | 18.9 | 48.7 | 55.8 | 32.6 | 32.7 | 35.3 | 35.2 | 35.7 | 39.4 | |
| OpenAI-Embed-3LRetrieval Setting=static2026.05 | 17.9 | 53.5 | 55.2 | 44.7 | 44.6 | 37.6 | 44.2 | 40.8 | 45.8 | |
| BM25Retrieval Setting=static2026.05 | 14.5 | 41.9 | 49.1 | 40.2 | 30.6 | 39.2 | 40.2 | 40.7 | 40.3 |