Multimodal Jailbreak Defense on AIAH Spell
0ASR (%)CASA
Evaluation results
| Method | Links | |
|---|---|---|
| CASAModel=Qwen_2.5_Omni, Model Size=3B, Safety Prompt=Yes2026.03 | 0 | |
| CBModel=Qwen_2.5_Omni, Model Size=3B, Safety Prompt=Yes2026.03 | 0.6 | |
| CASAModel=Qwen_2.5_Omni, Model Size=7B, Safety Prompt=Yes2026.03 | 0.6 | |
| CASAModel=Qwen_2.5_Omni, Model Size=7B, Safety Prompt=No2026.03 | 1.1 | |
| CBModel=Qwen_2.5_Omni, Model Size=7B, Safety Prompt=Yes2026.03 | 1.7 | |
| CBModel=Qwen_2.5_Omni, Model Size=3B, Safety Prompt=No2026.03 | 2.3 | |
| CASAModel=Qwen_2.5_Omni, Model Size=3B, Safety Prompt=No2026.03 | 2.3 | |
| SSFTModel=Qwen_2.5_Omni, Model Size=7B, Safety Prompt=Yes2026.03 | 6.3 | |
| CBModel=Qwen_2.5_Omni, Model Size=7B, Safety Prompt=No2026.03 | 24.4 | |
| SSFTModel=Qwen_2.5_Omni, Model Size=7B, Safety Prompt=No2026.03 | 25 | |
| Pre-TrainedModel=Qwen_2.5_Omni, Model Size=7B, Safety Prompt=Yes2026.03 | 42.6 | |
| SSFTModel=Qwen_2.5_Omni, Model Size=3B, Safety Prompt=Yes2026.03 | 58 | |
| Pre-TrainedModel=Qwen_2.5_Omni, Model Size=7B, Safety Prompt=No2026.03 | 64.2 | |
| Pre-TrainedModel=Qwen_2.5_Omni, Model Size=3B, Safety Prompt=Yes2026.03 | 67.6 | |
| SSFTModel=Qwen_2.5_Omni, Model Size=3B, Safety Prompt=No2026.03 | 71 | |
| Pre-TrainedModel=Qwen_2.5_Omni, Model Size=3B, Safety Prompt=No2026.03 | 81.3 |