Information Retrieval on BEIR BM25 Top-100 initial retrieval
84.7TREC-COVID ScoreListT5
Evaluation results
| Method | Links | |||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ListT5Model Size=3B, Basic unit r=22024.02 | 84.7 | 37.7 | 58.3 | 56.2 | 75.6 | 45.1 | 33.8 | 53.2 | 57.8 | 50.6 | 33.6 | 42.1 | 86.9 | 46.2 | 19.5 | 82 | 24.8 | 77 | 53.6 | |
| RankT5Model Size=3B2024.02 | 81.7 | 37.4 | 58.3 | 57.8 | 74.8 | 45.2 | 31.9 | 49.5 | 58.3 | 37.4 | 38.8 | 40.3 | 83.6 | 45 | 18.9 | 79.8 | 24.5 | 77.1 | 52.2 | |
| MonoT5Model Size=3B2024.02 | 79.8 | 37.3 | 57.5 | 56.4 | 74.3 | 46 | 32.2 | 48.3 | 58.5 | 46.8 | 32.5 | 41.3 | 84 | 44.8 | 19 | 80 | 26.2 | 76.3 | 52.3 | |
| MonoT5Model Size=base2024.02 | 78.3 | 35.7 | 55.3 | 52.1 | 71.2 | 39.2 | 32 | 48 | 53.4 | 34.4 | 29.6 | 38.6 | 84.6 | 42.8 | 16.7 | 78.4 | 23.1 | 73.1 | 49.3 | |
| ListT5Model Size=base, Basic unit r=22024.02 | 78.3 | 35.6 | 56.4 | 53.1 | 72.6 | 39.6 | 33.5 | 48.5 | 52.1 | 48.9 | 33.4 | 38.8 | 86.4 | 43.7 | 17.6 | 79.8 | 24 | 74.1 | 50.9 | |
| RankT5Model Size=base2024.02 | 77.7 | 35.1 | 58.2 | 53.2 | 72.8 | 39.2 | 30.8 | 45.4 | 54.3 | 35.5 | 37.1 | 37 | 83.3 | 43.7 | 16.8 | 77.6 | 21.2 | 73.5 | 49.6 | |
| BM25 Initial2024.02 | 59.5 | 32.2 | 52.2 | 30.5 | 63.3 | 23.6 | 33 | 39.5 | 40.7 | 40.8 | 44.2 | 30 | 78.9 | 31.8 | 14.9 | 65.2 | 16.5 | 67.9 | 42.5 |