Abnormal Behavior Detection on COLD-Attack (test)
1AccuracyAbnorDetector-Full
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| AbnorDetector-FullBase Model=Llama-3.1-8B-Instruct, alpha (α)=0.25, beta (β)=0.252025.04 | 1 | 0 | 0.9967 | |
| AbnorDetector-LiteBase Model=Gemma-7b-it, alpha (α)=0.25, beta (β)=0.252025.04 | 1 | 0 | 0.9615 | |
| AbnorDetector-FullBase Model=Gemma-7b-it, alpha (α)=0.25, beta (β)=0.252025.04 | 1 | 0 | 0.9917 | |
| AbnorDetector-FullBase Model=Gemma-7b-it, alpha (α)=0.125, beta (β)=0.1252025.04 | 1 | 0 | 0.995 | |
| AbnorDetector-LiteBase Model=Gemma-7b-it, alpha (α)=0.5, beta (β)=0.52025.04 | 0.9967 | 0.2222 | 0.9772 | |
| AbnorDetector-LiteBase Model=Llama-2-7b-chat, alpha (α)=0.5, beta (β)=0.52025.04 | 0.99 | 0 | 0.99 | |
| AbnorDetector-LiteBase Model=Llama-2-7b-chat, alpha (α)=0.25, beta (β)=0.252025.04 | 0.99 | 0 | 0.9933 | |
| AbnorDetector-FullBase Model=Llama-2-7b-chat, alpha (α)=0.25, beta (β)=0.252025.04 | 0.99 | 0 | 0.99 | |
| AbnorDetector-FullBase Model=Llama-2-7b-chat, alpha (α)=0.125, beta (β)=0.1252025.04 | 0.99 | 0 | 0.99 | |
| AbnorDetector-FullBase Model=Llama-3.1-70B-Instruct, alpha (α)=0.25, beta (β)=0.252025.04 | 0.98 | 0 | 0.9899 | |
| AbnorDetector-FullBase Model=Llama-3.1-70B-Instruct, alpha (α)=0.125, beta (β)=0.1252025.04 | 0.98 | 0 | 0.9899 | |
| GradSafeBase Model=Llama-2-7b-chat2025.04 | 0.98 | — | — | |
| AbnorDetector-FullBase Model=Llama-3.1-8B-Instruct, alpha (α)=0.125, beta (β)=0.1252025.04 | 0.9667 | 22.2222 | 0.9814 | |
| AbnorDetector-LiteBase Model=Llama-3.1-70B-Instruct, alpha (α)=0.5, beta (β)=0.52025.04 | 0.9567 | 1.5556 | 0.968 | |
| AbnorDetector-LiteBase Model=Llama-3.1-70B-Instruct, alpha (α)=0.25, beta (β)=0.252025.04 | 0.9333 | 2.8889 | 0.954 | |
| AbnorDetector-LiteBase Model=Llama-3.1-8B-Instruct, alpha (α)=0.5, beta (β)=0.52025.04 | 0.8767 | 10.8889 | 0.9244 | |
| AbnorDetector-LiteBase Model=Llama-3.1-8B-Instruct, alpha (α)=0.25, beta (β)=0.252025.04 | 0.76 | 4.6667 | 0.8202 |