Backdoor Attack Detection on BadNet
0VarianceAbnorDetector-Lite
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| AbnorDetector-LiteBackbone=Llama-2-7b-chat, Alpha (α)=0.5, Beta (β)=0.52025.04 | 0 | 100 | 100 | |
| AbnorDetector-LiteBackbone=Llama-2-7b-chat, Alpha (α)=0.25, Beta (β)=0.252025.04 | 0 | 99.5 | 99.5 | |
| AbnorDetector-FullBackbone=Llama-2-7b-chat, Alpha (α)=0.25, Beta (β)=0.252025.04 | 0 | 100 | 100 | |
| AbnorDetector-FullBackbone=Llama-2-7b-chat, Alpha (α)=0.125, Beta (β)=0.1252025.04 | 0 | 100 | 100 | |
| AbnorDetector-FullBackbone=Llama-3.1-8B-Instruct, Alpha (α)=0.25, Beta (β)=0.252025.04 | 0 | 99.5 | 99.5 | |
| AbnorDetector-FullBackbone=Llama-3.1-8B-Instruct, Alpha (α)=0.125, Beta (β)=0.1252025.04 | 0 | 99 | 99 | |
| AbnorDetector-LiteBackbone=Llama-3.1-70B-Instruct, Alpha (α)=0.5, Beta (β)=0.52025.04 | 0 | 99.5 | 99.5 | |
| AbnorDetector-FullBackbone=Llama-3.1-70B-Instruct, Alpha (α)=0.25, Beta (β)=0.252025.04 | 0 | 100 | 100 | |
| AbnorDetector-FullBackbone=Llama-3.1-70B-Instruct, Alpha (α)=0.125, Beta (β)=0.1252025.04 | 0 | 100 | 100 | |
| AbnorDetector-FullBackbone=Gemma-7b-it, Alpha (α)=0.25, Beta (β)=0.252025.04 | 0 | 100 | 100 | |
| AbnorDetector-FullBackbone=Gemma-7b-it, Alpha (α)=0.125, Beta (β)=0.1252025.04 | 0 | 100 | 100 | |
| AbnorDetector-LiteBackbone=Llama-3.1-70B-Instruct, Alpha (α)=0.25, Beta (β)=0.252025.04 | 0.0556 | 99.83 | 99.83 | |
| AbnorDetector-LiteBackbone=Llama-3.1-8B-Instruct, Alpha (α)=0.5, Beta (β)=0.52025.04 | 0.7222 | 88.33 | 88.32 | |
| AbnorDetector-LiteBackbone=Gemma-7b-it, Alpha (α)=0.25, Beta (β)=0.252025.04 | 1.5 | 88 | 87.97 | |
| AbnorDetector-LiteBackbone=Llama-3.1-8B-Instruct, Alpha (α)=0.25, Beta (β)=0.252025.04 | 1.5556 | 80.17 | 80.14 | |
| AbnorDetector-LiteBackbone=Gemma-7b-it, Alpha (α)=0.5, Beta (β)=0.52025.04 | 2.7222 | 81.17 | 81.02 | |
| ONIONThreshold (bar)=752025.04 | 79.2 | — | — | |
| ONIONThreshold (bar)=502025.04 | 89 | — | — | |
| ONIONThreshold (bar)=252025.04 | 97.6 | — | — |