Defense against empirical attacks on TREC DL 2019
97.6Query+BGE
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| BGEBackbone=BGE2025.12 | 97.6 | 53.6 | 24.4 | 30.9 | |
| BERT-baseBackbone=BERT-base2025.12 | 95.2 | 70.7 | 24.4 | 85.7 | |
| PGD-ADVRobustness enhancement method=PGD-ADV2025.12 | 88.1 | 68.3 | 22 | 64.3 | |
| RobustMaskBackbone=BGE, Masking Ratio=30%, Robustness enhancement method=RobustMask2025.12 | 83.3 | 26.8 | 7.3 | 7.3 | |
| RobustMaskBackbone=BERT, Masking Ratio=30%, Robustness enhancement method=RobustMask2025.12 | 81 | 43.9 | 9.8 | 28.6 | |
| PAT-ADVRobustness enhancement method=PAT-ADV2025.12 | 71.4 | 51.2 | 17.7 | 50 | |
| RobustMaskBackbone=BERT, Masking Ratio=60%, Robustness enhancement method=RobustMask2025.12 | 57.1 | 41.5 | 26.8 | 23.8 | |
| RobustMaskBackbone=BERT, Masking Ratio=90%, Robustness enhancement method=RobustMask2025.12 | 38.1 | 26.8 | 24.4 | 21.4 | |
| RobustMaskBackbone=BGE, Masking Ratio=60%, Robustness enhancement method=RobustMask2025.12 | 33.3 | 7.3 | 2.4 | 0 | |
| RobustMaskBackbone=BGE, Masking Ratio=90%, Robustness enhancement method=RobustMask2025.12 | 2.4 | 0 | 0 | 0 |