Backdoor Attack Detection on VPI
0VarianceAbnorDetector-Full
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| AbnorDetector-FullBackbone=Llama-2-7b-chat, Alpha (α)=0.25, Beta (β)=0.252025.04 | 0 | 99.5 | 99.5 | |
| AbnorDetector-FullBackbone=Llama-2-7b-chat, Alpha (α)=0.125, Beta (β)=0.1252025.04 | 0 | 99.5 | 99.5 | |
| AbnorDetector-FullBackbone=Llama-3.1-8B-Instruct, Alpha (α)=0.125, Beta (β)=0.1252025.04 | 0 | 99 | 99 | |
| AbnorDetector-LiteBackbone=Llama-3.1-70B-Instruct, Alpha (α)=0.25, Beta (β)=0.252025.04 | 0 | 100 | 100 | |
| AbnorDetector-FullBackbone=Llama-3.1-70B-Instruct, Alpha (α)=0.25, Beta (β)=0.252025.04 | 0 | 100 | 100 | |
| AbnorDetector-FullBackbone=Llama-3.1-70B-Instruct, Alpha (α)=0.125, Beta (β)=0.1252025.04 | 0 | 100 | 100 | |
| AbnorDetector-FullBackbone=Gemma-7b-it, Alpha (α)=0.25, Beta (β)=0.252025.04 | 0 | 100 | 100 | |
| AbnorDetector-FullBackbone=Gemma-7b-it, Alpha (α)=0.125, Beta (β)=0.1252025.04 | 0 | 100 | 100 | |
| AbnorDetector-LiteBackbone=Llama-2-7b-chat, Alpha (α)=0.5, Beta (β)=0.52025.04 | 0.0556 | 99.83 | 99.83 | |
| AbnorDetector-FullBackbone=Llama-3.1-8B-Instruct, Alpha (α)=0.25, Beta (β)=0.252025.04 | 0.0556 | 99.17 | 99.17 | |
| AbnorDetector-LiteBackbone=Llama-3.1-70B-Instruct, Alpha (α)=0.5, Beta (β)=0.52025.04 | 0.0556 | 99.83 | 99.83 | |
| AbnorDetector-LiteBackbone=Llama-2-7b-chat, Alpha (α)=0.25, Beta (β)=0.252025.04 | 0.1667 | 99.5 | 99.5 | |
| AbnorDetector-LiteBackbone=Llama-3.1-8B-Instruct, Alpha (α)=0.5, Beta (β)=0.52025.04 | 1.1667 | 87 | 86.98 | |
| AbnorDetector-LiteBackbone=Llama-3.1-8B-Instruct, Alpha (α)=0.25, Beta (β)=0.252025.04 | 1.5 | 78 | 77.96 | |
| AbnorDetector-LiteBackbone=Gemma-7b-it, Alpha (α)=0.25, Beta (β)=0.252025.04 | 2 | 78 | 77.81 | |
| AbnorDetector-LiteBackbone=Gemma-7b-it, Alpha (α)=0.5, Beta (β)=0.52025.04 | 10.5 | 80 | 79.66 | |
| ONIONThreshold (bar)=752025.04 | 33.2 | — | — | |
| ONIONThreshold (bar)=502025.04 | 51.8 | — | — | |
| ONIONThreshold (bar)=252025.04 | 76.4 | — | — |