System ranking correlation on TREC-DL 2022 2 (test)
0.937Kendall's tau (MAP@100)Rank1
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Rank1adaptation=direct generation, parameters=14B2026.01 | 0.937 | 0.747 | |
| Rank1adaptation=direct generation, parameters=32B2026.01 | 0.927 | 0.759 | |
| Rank1adaptation=direct generation, parameters=7B2026.01 | 0.922 | 0.741 | |
| UMBRELAadaptation=direct generation2026.01 | 0.905 | 0.774 | |
| monoT5adaptation=direct generation, size=3B2026.01 | 0.879 | 0.696 | |
| monoT5adaptation=direct generation, size=large2026.01 | 0.825 | 0.625 | |
| monoT5adaptation=direct generation, size=base2026.01 | 0.81 | 0.606 |