System ranking correlation on TREC-DL 2023 2 (test)
0.909Kendall's tau (MAP@100)Rank1
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Rank1adaptation=direct generation, parameters=14B2026.01 | 0.909 | 0.797 | |
| Rank1adaptation=direct generation, parameters=32B2026.01 | 0.899 | 0.834 | |
| Rank1adaptation=direct generation, parameters=7B2026.01 | 0.889 | 0.817 | |
| UMBRELAadaptation=direct generation2026.01 | 0.849 | 0.844 | |
| monoT5adaptation=direct generation, size=3B2026.01 | 0.829 | 0.669 | |
| monoT5adaptation=direct generation, size=large2026.01 | 0.825 | 0.741 | |
| monoT5adaptation=direct generation, size=base2026.01 | 0.792 | 0.479 |