Information Retrieval on BRIGHT BEIR
60NDCG@10 (Bio)DCI-Agent-Lite
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| DCI-Agent-LiteRetrieval Type=DCI-style agent, Base Model=GPT-5.4 Nano2026.06 | 60 | 50.8 | 32.3 | 42.4 | 81.9 | 72.7 | 56.7 | 9.7 | |
| ReasonRank-32BRetrieval Type=Learned ranking baseline, Model Size=32B2026.06 | 58.2 | 48.9 | 36.6 | 33.9 | 28.7 | 75.5 | 47 | — | |
| DR-DCIRetrieval Type=DCI-style agent, Base Model=GPT-5.4 Nano2026.06 | 52.9 | 49.3 | 34 | 32.5 | 77.3 | 79.3 | 54.2 | 7.2 | |
| Rank1-32BRetrieval Type=Learned ranking baseline, Model Size=32B2026.06 | 49.7 | 35.8 | 22 | 22.5 | 57.6 | 74.8 | 43.7 | 3.3 | |
| Rank-R1-14BRetrieval Type=Learned ranking baseline, Model Size=14B2026.06 | 31.2 | 38.5 | 21.2 | 22.6 | 31.3 | 72.2 | 36.2 | 10.8 | |
| GTE-Qwen2-7B-InstructRetrieval Type=Dense, Model Size=7B2026.06 | 30.6 | 36.4 | 17.8 | 13.2 | 62.7 | 75.3 | 39.3 | 7.7 | |
| OpenAI-text-emb-3-largeRetrieval Type=Dense2026.06 | 23.3 | 26.7 | 19.5 | 12.8 | 58.1 | 58.1 | 33.1 | 13.9 | |
| BM25Retrieval Type=Sparse2026.06 | 18.9 | 27.2 | 14.9 | 13.6 | 31.5 | 15.8 | 20.3 | 26.7 |