Relevance Judgment Agreement on TREC-DL 2022
0.425Cohen's KappaRank1-7B
Evaluation results
| Method | Links | |
|---|---|---|
| Rank1-7BAdaptation=Direct generation2026.01 | 0.425 | |
| UMBRELAAdaptation=Direct generation2026.01 | 0.421 | |
| Rank1-14BAdaptation=Direct generation2026.01 | 0.421 | |
| Rank1-32BAdaptation=Direct generation2026.01 | 0.42 | |
| monoT5 3BAdaptation=Direct generation2026.01 | 0.279 | |
| monoT5 largeAdaptation=Direct generation2026.01 | 0.246 | |
| monoT5 baseAdaptation=Direct generation2026.01 | 0.239 |