Passage Reranking on BEIR
44.3FiQA ScoreDebiasFirst
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| DebiasFirstOrder=Original, First-stage retriever=Contriever2026.04 | 44.3 | 75.8 | 37.8 | 68.2 | 21.3 | 76.6 | 51.9 | 79.6 | 24.9 | 52.4 | |
| DebiasFirstOrder=Shuffle, First-stage retriever=Contriever2026.04 | 44.3 | 75.5 | 37.6 | 68.1 | 20.7 | 75.5 | 51.7 | 78.8 | 24.6 | 52 | |
| FirstOrder=Original, First-stage retriever=Contriever2026.04 | 42.4 | 74.2 | 37.4 | 66.3 | 20.5 | 74.6 | 50.8 | 79 | 26.9 | 51.6 | |
| RankZephyrOrder=Original, First-stage retriever=Contriever2026.04 | 42.2 | 71.6 | 37.7 | 65.6 | 20.5 | 76.7 | 50 | 78.4 | 25.6 | 51.1 | |
| ListT5(r=2)Order=Shuffle, First-stage retriever=Contriever2026.04 | 42 | 70 | 35.7 | 57.9 | 18 | 73.9 | 44.3 | 77 | 23.8 | 48.8 | |
| ListT5(r=2)Order=Original, First-stage retriever=Contriever2026.04 | 41.7 | 71.5 | 36.3 | 53.1 | 17.2 | 74.1 | 46.1 | 80.3 | 24.4 | 49.1 | |
| RankZephyrOrder=Shuffle, First-stage retriever=Contriever2026.04 | 39.9 | 70.1 | 37.2 | 65.1 | 19.4 | 74.3 | 49.1 | 76.9 | 25.4 | 49.8 | |
| First modelOrder=Shuffle, First-stage retriever=Contriever2026.04 | 39.2 | 73.3 | 35.1 | 65.6 | 18.9 | 73.5 | 48.6 | 76.4 | 25.4 | 49.8 |