Information Retrieval on MS MARCO TREC DL19 1.0 (test)
0.648nDCG@10Attention Bleed-through Mitigation
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Attention Bleed-through MitigationBackbone=ColBERT, Injection Configuration=Abs-P Before, Alpha (a*)=0.32024.05 | 0.648 | 0.862 | 0.119 | |
| Attention Bleed-through MitigationBackbone=ColBERT, Injection Configuration=Rel-P Before, Alpha (a*)=0.32024.05 | 0.643 | 0.862 | 0.13 | |
| Attention Bleed-through MitigationBackbone=monoT5, Injection Configuration=Abs-P Before, Alpha (a*)=0.92024.05 | 0.634 | 0.838 | 0.143 | |
| Attention Bleed-through MitigationBackbone=monoT5, Injection Configuration=Rel-P Before, Alpha (a*)=0.92024.05 | 0.624 | 0.838 | 0.153 | |
| Attention Bleed-through MitigationBackbone=ColBERT, Injection Configuration=Abs-P Middle, Alpha (a*)=0.12024.05 | 0.614 | 0.815 | 0.112 | |
| Attention Bleed-through MitigationBackbone=ColBERT, Injection Configuration=Rel-P After, Alpha (a*)=0.12024.05 | 0.614 | 0.816 | 0.108 | |
| Attention Bleed-through MitigationBackbone=monoT5, Injection Configuration=Abs-P Middle, Alpha (a*)=0.62024.05 | 0.611 | 0.782 | 0.127 | |
| Attention Bleed-through MitigationBackbone=monoT5, Injection Configuration=Rel-P After, Alpha (a*)=0.62024.05 | 0.61 | 0.782 | 0.126 | |
| Attention Bleed-through MitigationBackbone=ColBERT, Injection Configuration=Abs-P After, Alpha (a*)=0.12024.05 | 0.607 | 0.813 | 0.126 | |
| Attention Bleed-through MitigationBackbone=monoT5, Injection Configuration=Abs-P After, Alpha (a*)=0.62024.05 | 0.606 | 0.78 | 0.134 | |
| Attention Bleed-through MitigationBackbone=Contriever, Injection Configuration=Abs-P Before, Alpha (a*)=0.22024.05 | 0.589 | 0.783 | 0.151 | |
| Attention Bleed-through MitigationBackbone=Contriever, Injection Configuration=Rel-P Before, Alpha (a*)=0.32024.05 | 0.581 | 0.768 | 0.152 | |
| Attention Bleed-through MitigationBackbone=Contriever, Injection Configuration=Abs-P Middle, Alpha (a*)=0.32024.05 | 0.573 | 0.765 | 0.159 | |
| Attention Bleed-through MitigationBackbone=Contriever, Injection Configuration=Rel-P After, Alpha (a*)=0.42024.05 | 0.573 | 0.761 | 0.127 | |
| Attention Bleed-through MitigationBackbone=Contriever, Injection Configuration=Abs-P After, Alpha (a*)=0.42024.05 | 0.567 | 0.76 | 0.139 | |
| Attention Bleed-through MitigationBackbone=BM25, Injection Configuration=Abs-P Before, Alpha (a*)=0.12024.05 | 0.414 | 0.619 | 0.121 | |
| Attention Bleed-through MitigationBackbone=BM25, Injection Configuration=Rel-P Before, Alpha (a*)=0.12024.05 | 0.409 | 0.618 | 0.13 | |
| Attention Bleed-through MitigationBackbone=BM25, Injection Configuration=Abs-P Middle, Alpha (a*)=0.12024.05 | 0.406 | 0.616 | 0.13 | |
| Attention Bleed-through MitigationBackbone=BM25, Injection Configuration=Rel-P After, Alpha (a*)=0.12024.05 | 0.405 | 0.616 | 0.134 | |
| Attention Bleed-through MitigationBackbone=BM25, Injection Configuration=Abs-P After, Alpha (a*)=0.12024.05 | 0.404 | 0.616 | 0.139 |