Information Retrieval Defense on TREC DL 2019 (test)
97.6Query+BGE
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| BGEBackbone=BGE, Evaluation Rank=Top-102025.12 | 97.6 | 68.3 | 31.7 | 35.7 | |
| BERT-baseBackbone=BERT-base, Evaluation Rank=Top-102025.12 | 92.9 | 51.2 | 29.3 | 78.6 | |
| RobustMaskBackbone=BGE, Mask Rate=30%, Evaluation Rank=Top-102025.12 | 83.3 | 36.9 | 4.87 | 21.9 | |
| PGD-ADVEvaluation Rank=Top-102025.12 | 73.8 | 75.6 | 31.7 | 38.1 | |
| RobustMaskBackbone=BERT, Mask Rate=30%, Evaluation Rank=Top-102025.12 | 64.3 | 31.7 | 12.2 | 38.1 | |
| PAT-ADVEvaluation Rank=Top-102025.12 | 57.1 | 43.9 | 26.8 | 31 | |
| RobustMaskBackbone=BERT, Mask Rate=60%, Evaluation Rank=Top-102025.12 | 33.3 | 22 | 14.6 | 33.3 | |
| RobustMaskBackbone=BGE, Mask Rate=60%, Evaluation Rank=Top-102025.12 | 14.3 | 4.9 | 2.4 | 2.4 | |
| RobustMaskBackbone=BERT, Mask Rate=90%, Evaluation Rank=Top-102025.12 | 11.9 | 9.8 | 9.8 | 23.8 | |
| RobustMaskBackbone=BGE, Mask Rate=90%, Evaluation Rank=Top-102025.12 | 0 | 0 | 0 | 0 |