System ranking correlation on TREC-DL 20
0.93MAP@100UMBRELA
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| UMBRELAadaptation=score thresholding2026.01 | 0.93 | 0.837 | |
| Rank1-32Badaptation=score thresholding2026.01 | 0.89 | 0.83 | |
| Rank1-14Badaptation=score thresholding2026.01 | 0.887 | 0.82 | |
| Rank1-7Badaptation=score thresholding2026.01 | 0.884 | 0.795 | |
| RankLLaMA-7Badaptation=score thresholding2026.01 | 0.877 | 0.664 | |
| RankLLaMA-13Badaptation=score thresholding2026.01 | 0.876 | 0.651 | |
| monoT5 3Badaptation=score thresholding2026.01 | 0.868 | 0.752 | |
| monoT5 largeadaptation=score thresholding2026.01 | 0.832 | 0.714 | |
| monoT5 baseadaptation=score thresholding2026.01 | 0.795 | 0.668 |