Backdoor Detection on Poisoned Prompt Set
100Prompt Flagging Ratebadnet-X-step100
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| badnet-X-step100Training Method=FFT, Attack Type=badnet, Target Identifier=X, Training Steps=1002025.07 | 100 | 100 | 0 | 15.2 | |
| badnet-X-step200Training Method=FFT, Attack Type=badnet, Target Identifier=X, Training Steps=2002025.07 | 100 | 100 | 0 | 82.8 | |
| badnet-X-step300Training Method=FFT, Attack Type=badnet, Target Identifier=X, Training Steps=3002025.07 | 100 | 100 | 0 | 81.8 | |
| badnet-X-step400Training Method=FFT, Attack Type=badnet, Target Identifier=X, Training Steps=4002025.07 | 100 | 100 | 1 | 94.9 | |
| badnet-X-step500Training Method=FFT, Attack Type=badnet, Target Identifier=X, Training Steps=5002025.07 | 100 | 100 | 21.2 | 100 | |
| badnet-Y-step100Training Method=FFT, Attack Type=badnet, Target Identifier=Y, Training Steps=1002025.07 | 100 | 100 | 0 | 0 | |
| badnet-Y-step200Training Method=FFT, Attack Type=badnet, Target Identifier=Y, Training Steps=2002025.07 | 100 | 100 | 0 | 28.3 | |
| badnet-Y-step300Training Method=FFT, Attack Type=badnet, Target Identifier=Y, Training Steps=3002025.07 | 100 | 100 | 0 | 0 | |
| badnet-Y-step400Training Method=FFT, Attack Type=badnet, Target Identifier=Y, Training Steps=4002025.07 | 100 | 100 | 0 | 28.3 | |
| badnet-Y-step500Training Method=FFT, Attack Type=badnet, Target Identifier=Y, Training Steps=5002025.07 | 100 | 100 | 9.1 | 99 | |
| badnet-Z-step100Training Method=FFT, Attack Type=badnet, Target Identifier=Z, Training Steps=1002025.07 | 100 | 100 | 0 | 0 | |
| badnet-Z-step200Training Method=FFT, Attack Type=badnet, Target Identifier=Z, Training Steps=2002025.07 | 100 | 100 | 0 | 29.3 | |
| badnet-Z-step300Training Method=FFT, Attack Type=badnet, Target Identifier=Z, Training Steps=3002025.07 | 100 | 100 | 0 | 15.2 | |
| badnet-Z-step400Training Method=FFT, Attack Type=badnet, Target Identifier=Z, Training Steps=4002025.07 | 100 | 100 | 0 | 13.1 | |
| badnet-Z-step500Training Method=FFT, Attack Type=badnet, Target Identifier=Z, Training Steps=5002025.07 | 100 | 100 | 15.2 | 99 | |
| ctba-X-step100Training Method=FFT, Attack Type=ctba, Target Identifier=X, Training Steps=1002025.07 | 100 | 100 | 0 | 2 | |
| ctba-X-step200Training Method=FFT, Attack Type=ctba, Target Identifier=X, Training Steps=2002025.07 | 100 | 100 | 0 | 37.4 | |
| ctba-X-step300Training Method=FFT, Attack Type=ctba, Target Identifier=X, Training Steps=3002025.07 | 100 | 100 | 0 | 62.6 | |
| ctba-X-step400Training Method=FFT, Attack Type=ctba, Target Identifier=X, Training Steps=4002025.07 | 100 | 100 | 0 | 4 | |
| ctba-X-step500Training Method=FFT, Attack Type=ctba, Target Identifier=X, Training Steps=5002025.07 | 100 | 100 | 2 | 100 | |
| ctba-Y-step100Training Method=FFT, Attack Type=ctba, Target Identifier=Y, Training Steps=1002025.07 | 100 | 100 | 0 | 0 | |
| ctba-Y-step200Training Method=FFT, Attack Type=ctba, Target Identifier=Y, Training Steps=2002025.07 | 100 | 100 | 0 | 20.2 | |
| ctba-Y-step300Training Method=FFT, Attack Type=ctba, Target Identifier=Y, Training Steps=3002025.07 | 100 | 100 | 0 | 10.1 | |
| ctba-Y-step400Training Method=FFT, Attack Type=ctba, Target Identifier=Y, Training Steps=4002025.07 | 100 | 100 | 0 | 13.1 | |
| ctba-Y-step500Training Method=FFT, Attack Type=ctba, Target Identifier=Y, Training Steps=5002025.07 | 100 | 100 | 0 | 72.7 | |
| ctba-Z-step100Training Method=FFT, Attack Type=ctba, Target Identifier=Z, Training Steps=1002025.07 | 100 | 100 | 0 | 0 | |
| ctba-Z-step200Training Method=FFT, Attack Type=ctba, Target Identifier=Z, Training Steps=2002025.07 | 100 | 100 | 0 | 1 | |
| ctba-Z-step300Training Method=FFT, Attack Type=ctba, Target Identifier=Z, Training Steps=3002025.07 | 100 | 100 | 0 | 0 | |
| ctba-Z-step400Training Method=FFT, Attack Type=ctba, Target Identifier=Z, Training Steps=4002025.07 | 100 | 100 | 0 | 12.1 | |
| ctba-Z-step500Training Method=FFT, Attack Type=ctba, Target Identifier=Z, Training Steps=5002025.07 | 100 | 100 | 0 | 23.2 | |
| mtba-X-step300Training Method=FFT, Attack Type=mtba, Target Identifier=X, Training Steps=3002025.07 | 100 | 100 | 0 | 0 | |
| mtba-X-step400Training Method=FFT, Attack Type=mtba, Target Identifier=X, Training Steps=4002025.07 | 100 | 100 | 0 | 9.1 | |
| mtba-X-step500Training Method=FFT, Attack Type=mtba, Target Identifier=X, Training Steps=5002025.07 | 100 | 100 | 5.1 | 87.9 | |
| mtba-Y-step200Training Method=FFT, Attack Type=mtba, Target Identifier=Y, Training Steps=2002025.07 | 100 | 100 | 0 | 3 | |
| mtba-Y-step300Training Method=FFT, Attack Type=mtba, Target Identifier=Y, Training Steps=3002025.07 | 100 | 100 | 0 | 67.7 | |
| mtba-Y-step400Training Method=FFT, Attack Type=mtba, Target Identifier=Y, Training Steps=4002025.07 | 100 | 100 | 0 | 76.8 | |
| mtba-Y-step500Training Method=FFT, Attack Type=mtba, Target Identifier=Y, Training Steps=5002025.07 | 100 | 100 | 4 | 90.9 | |
| mtba-Z-step300Training Method=FFT, Attack Type=mtba, Target Identifier=Z, Training Steps=3002025.07 | 100 | 100 | 0 | 1 | |
| mtba-Z-step400Training Method=FFT, Attack Type=mtba, Target Identifier=Z, Training Steps=4002025.07 | 100 | 100 | 0 | 20.2 | |
| mtba-Z-step500Training Method=FFT, Attack Type=mtba, Target Identifier=Z, Training Steps=5002025.07 | 100 | 100 | 0 | 64.6 | |
| trojan2Training Method=PPO, Attack Type=trojan, Target Identifier=22025.07 | 100 | 100 | 0.32 | 1.92 | |
| trojan3Training Method=PPO, Attack Type=trojan, Target Identifier=32025.07 | 100 | 100 | 31.95 | 97.76 | |
| trojan4Training Method=PPO, Attack Type=trojan, Target Identifier=42025.07 | 100 | 100 | 2.88 | 26.84 | |
| trojan5Training Method=PPO, Attack Type=trojan, Target Identifier=52025.07 | 100 | 100 | 7.99 | 43.45 | |
| trojan1Training Method=PPO, Attack Type=trojan, Target Identifier=12025.07 | 98.72 | 99.04 | 1.92 | 63.58 | |
| mtba-X-step200Training Method=FFT, Attack Type=mtba, Target Identifier=X, Training Steps=2002025.07 | 96 | 96 | 0 | 9.1 | |
| mtba-X-step100Training Method=FFT, Attack Type=mtba, Target Identifier=X, Training Steps=1002025.07 | 83.8 | 84.8 | 0 | 0 | |
| mtba-Z-step100Training Method=FFT, Attack Type=mtba, Target Identifier=Z, Training Steps=1002025.07 | 83.8 | 83.8 | 0 | 0 | |
| mtba-Y-step100Training Method=FFT, Attack Type=mtba, Target Identifier=Y, Training Steps=1002025.07 | 70.7 | 70.7 | 0 | 0 | |
| mtba-Z-step200Training Method=FFT, Attack Type=mtba, Target Identifier=Z, Training Steps=2002025.07 | 61.6 | 64.6 | 0 | 2 |