Passage Re-ranking on TREC DL mean 2019 2020
2,500Calls per Query (Top 100)SW-BB
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| SW-BBBackbone=Q0.8B, Pool Size=1002026.06 | 2,500 | 16.1 | 50 | — | |
| SW-BBBackbone=Q2B, Pool Size=1002026.06 | 2,500 | 56.9 | 50 | — | |
| SW-BBBackbone=Q4B, Pool Size=1002026.06 | 2,500 | 60.6 | 50 | — | |
| SW-BBBackbone=Q9B, Pool Size=1002026.06 | 2,500 | 65.6 | 50 | — | |
| SW-BBBackbone=Q27B, Pool Size=1002026.06 | 2,500 | 71.6 | 50 | — | |
| SW-BBBackbone=L8B, Pool Size=1002026.06 | 2,500 | 55.6 | 50 | — | |
| SW-BBBackbone=M3B, Pool Size=1002026.06 | 2,500 | 63.2 | 50 | — | |
| SW-BBBackbone=M8B, Pool Size=1002026.06 | 2,500 | 64.4 | 50 | — | |
| SW-BBBackbone=M14B, Pool Size=1002026.06 | 2,500 | 64.1 | 50 | — | |
| SW-BBBackbone=Avg., Pool Size=1002026.06 | 2,500 | — | 50 | 57.6 | |
| SW-TBBackbone=Q0.8B, Pool Size=1002026.06 | 447.7 | 54.5 | 8.95 | — | |
| SW-TBBackbone=Q2B, Pool Size=1002026.06 | 447.7 | 62.7 | 8.95 | — | |
| SW-TBBackbone=Q4B, Pool Size=1002026.06 | 447.7 | 69.8 | 8.95 | — | |
| SW-TBBackbone=Q9B, Pool Size=1002026.06 | 447.7 | 71.3 | 8.95 | — | |
| SW-TBBackbone=Q27B, Pool Size=1002026.06 | 447.7 | 73.3 | 8.95 | — | |
| SW-TBBackbone=L8B, Pool Size=1002026.06 | 447.7 | 66.3 | 8.95 | — | |
| SW-TBBackbone=M3B, Pool Size=1002026.06 | 447.7 | 67.1 | 8.95 | — | |
| SW-TBBackbone=M8B, Pool Size=1002026.06 | 447.7 | 70.3 | 8.95 | — | |
| SW-TBBackbone=M14B, Pool Size=1002026.06 | 447.7 | 70.8 | 8.95 | — | |
| SW-TBBackbone=Avg., Pool Size=1002026.06 | 447.7 | — | 8.95 | 67.3 | |
| SW-BHBackbone=Q0.8B, Pool Size=1002026.06 | 436.3 | 20.3 | 8.73 | — | |
| SW-BHBackbone=Q2B, Pool Size=1002026.06 | 436.3 | 51.3 | 8.73 | — | |
| SW-BHBackbone=Q4B, Pool Size=1002026.06 | 436.3 | 55.5 | 8.73 | — | |
| SW-BHBackbone=Q9B, Pool Size=1002026.06 | 436.3 | 63.2 | 8.73 | — | |
| SW-BHBackbone=Q27B, Pool Size=1002026.06 | 436.3 | 71.4 | 8.73 | — | |
| SW-BHBackbone=L8B, Pool Size=1002026.06 | 436.3 | 52.2 | 8.73 | — | |
| SW-BHBackbone=M3B, Pool Size=1002026.06 | 436.3 | 60.5 | 8.73 | — | |
| SW-BHBackbone=M8B, Pool Size=1002026.06 | 436.3 | 58.3 | 8.73 | — | |
| SW-BHBackbone=M14B, Pool Size=1002026.06 | 436.3 | 59.1 | 8.73 | — | |
| SW-BHBackbone=Avg., Pool Size=1002026.06 | 436.3 | — | 8.73 | 54.6 | |
| SW-THBackbone=Q0.8B, Pool Size=1002026.06 | 123.1 | 51.4 | 2.46 | — | |
| SW-THBackbone=Q2B, Pool Size=1002026.06 | 123.1 | 63 | 2.46 | — | |
| SW-THBackbone=Q4B, Pool Size=1002026.06 | 123.1 | 70.2 | 2.46 | — | |
| SW-THBackbone=Q9B, Pool Size=1002026.06 | 123.1 | 71.7 | 2.46 | — | |
| SW-THBackbone=Q27B, Pool Size=1002026.06 | 123.1 | 73 | 2.46 | — | |
| SW-THBackbone=L8B, Pool Size=1002026.06 | 123.1 | 63.7 | 2.46 | — | |
| SW-THBackbone=M3B, Pool Size=1002026.06 | 123.1 | 66.3 | 2.46 | — | |
| SW-THBackbone=M8B, Pool Size=1002026.06 | 123.1 | 70.5 | 2.46 | — | |
| SW-THBackbone=M14B, Pool Size=1002026.06 | 123.1 | 70.8 | 2.46 | — | |
| SW-THBackbone=Avg., Pool Size=1002026.06 | 123.1 | — | 2.46 | 66.7 | |
| WP-TBackbone=Q0.8B, Pool Size=1002026.06 | 99 | 50.3 | 1.98 | — | |
| WP-TBackbone=Q2B, Pool Size=1002026.06 | 99 | 54.9 | 1.98 | — | |
| WP-TBackbone=Q4B, Pool Size=1002026.06 | 99 | 66.2 | 1.98 | — | |
| WP-TBackbone=Q9B, Pool Size=1002026.06 | 99 | 70.6 | 1.98 | — | |
| WP-TBackbone=Q27B, Pool Size=1002026.06 | 99 | 71.9 | 1.98 | — | |
| WP-TBackbone=L8B, Pool Size=1002026.06 | 99 | 62.2 | 1.98 | — | |
| WP-TBackbone=M3B, Pool Size=1002026.06 | 99 | 63 | 1.98 | — | |
| WP-TBackbone=M8B, Pool Size=1002026.06 | 99 | 70 | 1.98 | — | |
| WP-TBackbone=M14B, Pool Size=1002026.06 | 99 | 71.3 | 1.98 | — | |
| WP-TBackbone=Avg., Pool Size=1002026.06 | 99 | — | 1.98 | 64.5 | |
| WP-BBackbone=Q0.8B, Pool Size=1002026.06 | 99 | 44.6 | 1.98 | — | |
| WP-BBackbone=Q2B, Pool Size=1002026.06 | 99 | 48.2 | 1.98 | — | |
| WP-BBackbone=Q4B, Pool Size=1002026.06 | 99 | 51.8 | 1.98 | — | |
| WP-BBackbone=Q9B, Pool Size=1002026.06 | 99 | 62.3 | 1.98 | — | |
| WP-BBackbone=Q27B, Pool Size=1002026.06 | 99 | 67.6 | 1.98 | — | |
| WP-BBackbone=L8B, Pool Size=1002026.06 | 99 | 57.3 | 1.98 | — | |
| WP-BBackbone=M3B, Pool Size=1002026.06 | 99 | 54.8 | 1.98 | — | |
| WP-BBackbone=M8B, Pool Size=1002026.06 | 99 | 63.4 | 1.98 | — | |
| WP-BBackbone=M14B, Pool Size=1002026.06 | 99 | 61.3 | 1.98 | — | |
| WP-BBackbone=Avg., Pool Size=1002026.06 | 99 | — | 1.98 | 56.8 | |
| WP-DEBackbone=Q0.8B, Pool Size=1002026.06 | 50 | 40.1 | 1 | — | |
| WP-DEBackbone=Q2B, Pool Size=1002026.06 | 50 | 50.2 | 1 | — | |
| WP-DEBackbone=Q4B, Pool Size=1002026.06 | 50 | 65.8 | 1 | — | |
| WP-DEBackbone=Q9B, Pool Size=1002026.06 | 50 | 69.2 | 1 | — | |
| WP-DEBackbone=Q27B, Pool Size=1002026.06 | 50 | 71.9 | 1 | — | |
| WP-DEBackbone=L8B, Pool Size=1002026.06 | 50 | 60.9 | 1 | — | |
| WP-DEBackbone=M3B, Pool Size=1002026.06 | 50 | 64.9 | 1 | — | |
| WP-DEBackbone=M8B, Pool Size=1002026.06 | 50 | 70 | 1 | — | |
| WP-DEBackbone=M14B, Pool Size=1002026.06 | 50 | 71.6 | 1 | — | |
| WP-DEBackbone=Avg., Pool Size=1002026.06 | 50 | — | 1 | 62.7 | |
| BM25Backbone=Q0.8B, Pool Size=1002026.06 | 0 | 49.3 | 0 | — | |
| BM25Backbone=Q2B, Pool Size=1002026.06 | 0 | 49.3 | 0 | — | |
| BM25Backbone=Q4B, Pool Size=1002026.06 | 0 | 49.3 | 0 | — | |
| BM25Backbone=Q9B, Pool Size=1002026.06 | 0 | 49.3 | 0 | — | |
| BM25Backbone=Q27B, Pool Size=1002026.06 | 0 | 49.3 | 0 | — | |
| BM25Backbone=L8B, Pool Size=1002026.06 | 0 | 49.3 | 0 | — | |
| BM25Backbone=M3B, Pool Size=1002026.06 | 0 | 49.3 | 0 | — | |
| BM25Backbone=M8B, Pool Size=1002026.06 | 0 | 49.3 | 0 | — | |
| BM25Backbone=M14B, Pool Size=1002026.06 | 0 | 49.3 | 0 | — | |
| BM25Backbone=Avg., Pool Size=1002026.06 | 0 | — | 0 | 49.3 |