Ranking Attack on TREC DL 2020
97.74SRPRADA (Baseline)
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| PRADA (Baseline)Target Model=BERT-base-mdoc-BM252026.01 | 97.74 | 0.85 | 13.83 | 20.1 | 2.42 | |
| one_word_best_gradTarget Model=BERT-base-mdoc-BM252026.01 | 87.1 | 0.97 | 1.45 | 9.47 | 1.16 | |
| PRADA (Baseline)Target Model=monoT5-base-MSMARCO2026.01 | 59.62 | 0.88 | 3.55 | 7.42 | 0.94 | |
| one_word_best_gradTarget Model=monoT5-base-MSMARCO2026.01 | 59.49 | 0.96 | 1.1 | 7.95 | 1 | |
| one_word_startTarget Model=monoT5-base-MSMARCO2026.01 | 50.23 | 0.97 | 0.87 | 5.57 | 0.7 | |
| one_word_simTarget Model=monoT5-base-MSMARCO2026.01 | 45.53 | 0.98 | 0.8 | 4.34 | 0.52 | |
| one_word_startTarget Model=BERT-base-mdoc-BM252026.01 | 44.18 | 0.98 | 0.81 | 4.2 | 0.53 | |
| one_word_simTarget Model=BERT-base-mdoc-BM252026.01 | 30.9 | 0.98 | 0.7 | 2.06 | 0.24 |