Multimodal Attack Detection on Multimodal attack detection (test)
100PrecisionGemini-2.5-Flash-Lite†
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Gemini-2.5-Flash-Lite†Proprietary=true2026.04 | 100 | 70 | 82 | |
| GPT-4.1 Mini†Proprietary=true2026.04 | 100 | 87 | 93 | |
| SALLIEBackbone=SmolVLM2-2.2B-Instruct2026.04 | 99 | 35 | 52 | |
| HiddenDetect2026.04 | 97 | 31 | 47 | |
| SALLIEBackbone=Phi-3.5-vision-instruct2026.04 | 96 | 80 | 87 | |
| SALLIEBackbone=Gemma-3-4b-it2026.04 | 94 | 86 | 90 | |
| JailGuard2026.04 | 87 | 46 | 61 | |
| PIShield2026.04 | 57 | 91 | 70 | |
| EEG-Defender2026.04 | 56 | 57 | 56 | |
| Perplexity Filter2026.04 | 50 | 13 | 21 |