Attack Success Rate Evaluation on MMDS MMRT (test)
100ASRQwen2.5-VL-72B-Instruct
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen2.5-VL-72B-InstructTarget model=Qwen2.5-VL-72B-Instruct2025.09 | 100 | |
| GPT-4oTarget model=GPT-4o2025.09 | 98.21 | |
| InternVL3-78BTarget model=InternVL3-78B2025.09 | 95 | |
| LLaVA-OV-Chat-72BTarget model=LLaVA-OV-Chat-72B2025.09 | 93.33 | |
| Gemini-2.5-ProTarget model=Gemini-2.5-Pro2025.09 | 90 | |
| Claude-3.7-SonnetTarget model=Claude-3.7-Sonnet2025.09 | 73.77 | |
| GPT-5-MiniTarget model=GPT-5-Mini2025.09 | 51.67 |