System Ranking Correlation on TREC-DL 2019 (test)
0.946MAP@100UMBRELA
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| UMBRELAadaptation=score thresholding2026.01 | 0.946 | — | — | 0.832 | |
| Rank1-7Badaptation=score thresholding2026.01 | 0.91 | — | — | 0.835 | |
| Rank1-32Badaptation=score thresholding2026.01 | 0.91 | — | — | 0.808 | |
| monoT5 largeadaptation=score thresholding2026.01 | 0.898 | — | — | 0.749 | |
| Rank1-14Badaptation=score thresholding2026.01 | 0.898 | — | — | 0.763 | |
| monoT5 3Badaptation=score thresholding2026.01 | 0.892 | — | — | 0.818 | |
| RankLLaMA-13Badaptation=score thresholding2026.01 | 0.892 | — | — | 0.781 | |
| monoT5 baseadaptation=score thresholding2026.01 | 0.889 | — | — | 0.846 | |
| RankLLaMA-7Badaptation=score thresholding2026.01 | 0.889 | — | — | 0.806 | |
| monoT5adaptation=direct generation, size=base2026.01 | — | 0.883 | 0.839 | — | |
| monoT5adaptation=direct generation, size=large2026.01 | — | 0.91 | 0.841 | — | |
| monoT5adaptation=direct generation, size=3B2026.01 | — | 0.895 | 0.832 | — | |
| Rank1adaptation=direct generation, parameters=7B2026.01 | — | 0.901 | 0.835 | — | |
| Rank1adaptation=direct generation, parameters=14B2026.01 | — | 0.892 | 0.763 | — | |
| Rank1adaptation=direct generation, parameters=32B2026.01 | — | 0.916 | 0.808 | — | |
| UMBRELAadaptation=direct generation2026.01 | — | 0.946 | 0.832 | — |