Multimodal Safety Evaluation on MM-SafetyBench SD + TYPO + SD_TYPO (test)
0.08ASR ScoreDefenSee
Evaluation Results
| Method | Links | |
|---|---|---|
| DefenSeeTarget MLLM=Llava22025.12 | 0.08 | |
| AdaShield-ATarget MLLM=Llava22025.12 | 0.18 | |
| AdaShield-STarget MLLM=Llava22025.12 | 0.5 | |
| DefenSeeTarget MLLM=Minigpt42025.12 | 1.4 | |
| AdaShield-ATarget MLLM=Minigpt42025.12 | 8.11 | |
| AdaShield-STarget MLLM=Minigpt42025.12 | 10.34 | |
| ECSOTarget MLLM=Llava22025.12 | 35.1 | |
| ECSOTarget MLLM=Minigpt42025.12 | 43.04 |