Prompt Injection Detection on SCOUT-450
0ASR (hid)Attention tracker
Evaluation Results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Attention tracker2026.05 | 0 | 11.9 | 17.1 | 19.2 | 6.7 | 4.4 | 51.4 | 29.7 | 24 | 65.8 | |
| PIGuard2026.05 | 9.6 | 11.9 | 14.6 | 0 | 9.8 | 22.2 | 48.6 | 36.4 | 203 | 66.9 | |
| SCOUTThreshold (tau)=0.8752026.05 | 9.6 | 2.4 | 2.4 | 0 | 6.3 | 88.9 | 96.2 | 92.8 | 395 | 93.3 | |
| SCOUTThreshold (tau)=0.752026.05 | 10.3 | 2.4 | 4.9 | 3.8 | 7.5 | 87.8 | 86.7 | 87.2 | 222 | 90.2 | |
| GPT-4o2026.05 | 13.7 | 21.4 | 2.4 | 0 | 11.8 | 98.9 | 97.1 | 97.9 | 656 | 92.4 | |
| SCOUTThreshold (tau)=0.552026.05 | 14.4 | 2.4 | 7.3 | 7.7 | 10.6 | 80 | 79 | 79.5 | 87 | 85.1 | |
| GPT-3.52026.05 | 18.5 | 23.8 | 14.6 | 0 | 16.9 | 93.3 | 92.4 | 92.8 | 659 | 87.3 | |
| Logistic regression2026.05 | 34.9 | 16.7 | 14.6 | 3.8 | 25.5 | 62.2 | 50.5 | 55.9 | 10 | 66.4 | |
| DeBERTa2026.05 | 36.3 | 0 | 9.8 | 7.7 | 23.1 | 77.8 | 58.1 | 67.2 | 9 | 72.7 | |
| DistilBERT2026.05 | 58.9 | 31 | 24.4 | 7.7 | 43.5 | 84.4 | 68.6 | 75.9 | 3 | 64.9 | |
| AlignSentinel2026.05 | 59.6 | 21.4 | 29.3 | 19.2 | 44.3 | 71.1 | 88.6 | 80.5 | 26 | 66.4 | |
| Rule-based2026.05 | 65.1 | 52.4 | 70.7 | 76.9 | 65.1 | 75.6 | 71.4 | 73.3 | 0.1 | 51.6 | |
| InstructDetector2026.05 | 74 | 40.5 | 26.8 | 15.4 | 54.9 | 81.1 | 53.3 | 66.2 | 27 | 54.2 |