Information Retrieval on BRIGHT (test)
50.1Bio ScoreADORE
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| ADORETraining=Zero-shot2026.06 | 50.1 | 49 | 33.2 | 46.8 | 23.2 | 27.9 | 34.7 | 37.9 | |
| MUGICategory=Query Expansions w/ BM25, Training=Zero-shot2026.06 | 47.5 | 50.2 | 29.6 | 40.8 | 18.9 | 27.4 | 26.9 | 34.5 | |
| ThinkQECategory=Query Expansions w/ BM25, Training=Zero-shot2026.06 | 45.6 | 51.6 | 29.1 | 42 | 18.6 | 26.8 | 29.4 | 34.7 | |
| GenQREnsembleCategory=Query Expansions w/ BM25, Training=Zero-shot2026.06 | 42.4 | 47.1 | 23.1 | 32 | 15.6 | 26.6 | 17.2 | 29.1 | |
| GenQRCategory=Query Expansions w/ BM25, Training=Zero-shot2026.06 | 39.8 | 43.9 | 22.2 | 32 | 16 | 26.8 | 14.2 | 27.8 | |
| RankGPT4Category=Rerankers, Training=Zero-shot2026.06 | 33.8 | 34.2 | 16.7 | 27 | 22.3 | 27.7 | 11.1 | 24.7 | |
| CSQECategory=Query Expansions w/ BM25, Training=Zero-shot2026.06 | 32 | 45.5 | 20.9 | 26.5 | 13.7 | 21.5 | 20.1 | 25.7 | |
| LameRCategory=Query Expansions w/ BM25, Training=Zero-shot2026.06 | 31.5 | 40.8 | 19.7 | 25.8 | 13 | 22 | 20.6 | 24.8 | |
| Rank-R1-14BCategory=Rerankers, Training=GRPO (RL)2026.06 | 31.2 | 38.5 | 21.2 | 26.4 | 22.6 | 18.9 | 27.5 | 26.6 | |
| GTE-QWEN-7BCategory=Dense, Training=SFT2026.06 | 30.6 | 36.4 | 17.8 | 24.6 | 13.2 | 22.2 | 14.8 | 22.8 | |
| QA-ExpandCategory=Query Expansions w/ BM25, Training=Zero-shot2026.06 | 26.7 | 38.5 | 18.5 | 20.2 | 11.2 | 17.1 | 18.3 | 21.5 | |
| ReasonIR-8BCategory=Dense, Training=SFT2026.06 | 26.2 | 31.4 | 23.3 | 30 | 18 | 23.9 | 20.5 | 24.8 | |
| Query2Doc (FS)Category=Query Expansions w/ BM25, Training=Zero-shot2026.06 | 25.8 | 36.8 | 17.9 | 18.7 | 11.4 | 18.1 | 17.1 | 20.8 | |
| Query2Doc (ZS)Category=Query Expansions w/ BM25, Training=Zero-shot2026.06 | 25.5 | 38 | 17.2 | 20 | 12.6 | 19.2 | 18.4 | 21.6 | |
| Query2Doc (CoT)Category=Query Expansions w/ BM25, Training=Zero-shot2026.06 | 25.2 | 37.6 | 18.4 | 17.2 | 12.1 | 19.2 | 17.7 | 21.1 | |
| GritLM-7BCategory=Dense, Training=SFT2026.06 | 24.8 | 32.3 | 18.9 | 19.8 | 17.1 | 13.6 | 17.8 | 20.6 | |
| Query2ECategory=Query Expansions w/ BM25, Training=Zero-shot2026.06 | 23.9 | 37.6 | 18.1 | 18.7 | 12.1 | 19 | 16.2 | 20.8 | |
| RankZephyr-7BCategory=Rerankers, Training=GPT4-distill2026.06 | 21.9 | 23.7 | 14.4 | 10.3 | 7.6 | 13.7 | 16.6 | 15.5 | |
| BM25Category=Sparse, Training=Zero-shot2026.06 | 18.2 | 27.9 | 16.4 | 13.4 | 10.9 | 16.3 | 16.1 | 17 | |
| BM25 + RM3Category=Sparse, Training=Zero-shot2026.06 | 16 | 27.6 | 14.6 | 12.5 | 7.8 | 14.1 | 12.8 | 15 |