Backdoor Attack Task Predict Future on WebQuestion Howdy (Alpaca-howdy-52K distribution) (test)
100Top-5 auPRCRISE
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| RISEBackbone=OLMo-3-32B, Pre-trained=true, Top-K selection threshold=1002026.04 | 100 | 100 | 100 | 100 | 99.91 | 99.93 | 99.75 | 99.82 | |
| RISEBackbone=OLMo-3-7B, Pre-trained=true, Top-K selection threshold=1002026.04 | 100 | 100 | 100 | 100 | 99.94 | 99.95 | 99.75 | 99.82 | |
| RISEBackbone=OLMo-2-1B, Pre-trained=true, Top-K selection threshold=1002026.04 | 99.04 | 99.42 | 99.11 | 99.53 | 98.28 | 99.04 | 96.89 | 98.21 | |
| Embedding SimilarityBackbone=E5-base-v2, Pre-trained=true, Top-K selection threshold=1002026.04 | 40.89 | 82.83 | 37.4 | 70.47 | 31.51 | 64.11 | 29.67 | 67.25 | |
| TrackStarBackbone=OLMo-3-32B, Pre-trained=true, Top-K selection threshold=1002026.04 | 37.15 | 60.55 | 51.72 | 74.03 | 78.49 | 91.24 | 85.17 | 94.5 | |
| ZO-InfBackbone=OLMo-2-1B, Pre-trained=true, Top-K selection threshold=1002026.04 | 36.01 | 54.4 | 25.36 | 52.05 | 13.7 | 54.02 | 11.84 | 53.47 | |
| ZO-InfBackbone=OLMo-3-7B, Pre-trained=true, Top-K selection threshold=1002026.04 | 34.64 | 58.8 | 26.67 | 62.14 | 13.05 | 60.64 | 10.99 | 59.16 | |
| BM25Pre-trained=false, Top-K selection threshold=1002026.04 | 25.89 | 77.76 | 27.85 | 76.73 | 27.33 | 76.21 | 26.99 | 76.89 | |
| RapidInBackbone=OLMo-2-1B, Pre-trained=true, Top-K selection threshold=1002026.04 | 18.1 | 21.91 | 10.92 | 27.01 | 9.09 | 32.71 | 8.32 | 36.59 | |
| RapidInBackbone=OLMo-3-7B, Pre-trained=true, Top-K selection threshold=1002026.04 | 16.08 | 28.25 | 12.29 | 35.22 | 7.95 | 38.04 | 7.49 | 38.89 | |
| TrackStarBackbone=OLMo-2-1B, Pre-trained=true, Top-K selection threshold=1002026.04 | 5.1 | 38.78 | 24.35 | 59.02 | 46.2 | 77.96 | 52.35 | 82.81 | |
| TrackStarBackbone=OLMo-3-7B, Pre-trained=true, Top-K selection threshold=1002026.04 | 0.3 | 49.56 | 34.37 | 65.88 | 72.32 | 89.38 | 80.29 | 93.05 |