List your company
ResearchFormerly WizWand

Visual Jailbreaking Attack on AdvBench (ASR, Query)

43.84ASRFORCE
-1.753610.083221.9233.7568Sep 25, 2025Oct 10, 2025Oct 25, 2025Nov 9, 2025Nov 24, 2025Dec 9, 2025Dec 24, 2025
Updated 8mo ago

Evaluation results

MethodLinks
FORCEArchitecture=Adapter-Based MLLMs, Target Model=Llava-v1.6-mistral-7b2025.0943.8459.76
FORCEArchitecture=Adapter-Based MLLMs, Target Model=Idefics3-8B-Llama32025.0935.9667.49
PGDArchitecture=Adapter-Based MLLMs, Target Model=Llava-v1.6-mistral-7b2025.0935.1967.82
PGDArchitecture=Adapter-Based MLLMs, Target Model=Idefics3-8B-Llama32025.0929.8171.57
FORCEArchitecture=Adapter-Based MLLMs, Target Model=InstructBlip-Vicuna-7B2025.0927.8877.04
PGDArchitecture=Adapter-Based MLLMs, Target Model=InstructBlip-Vicuna-7B2025.0925.5879.45
FORCEArchitecture=Commercial MLLMs, Target Model=Gemini-2.5-Pro2025.09695.17
PGDArchitecture=Commercial MLLMs, Target Model=Gemini-2.5-Pro2025.09496.59
FORCEArchitecture=Early-Fusion MLLMs, Target Model=Qwen2.5-VL-7B-Instruct2025.092.6997.22
FORCEArchitecture=Early-Fusion MLLMs, Target Model=Llama-3.2-11B-Vision-Instruct2025.092.3198.02
PGDArchitecture=Early-Fusion MLLMs, Target Model=Qwen2.5-VL-7B-Instruct2025.091.5498.65
PGDArchitecture=Early-Fusion MLLMs, Target Model=Llama-3.2-11B-Vision-Instruct2025.091.1598.94
PGDArchitecture=Commercial MLLMs, Target Model=Claude-Sonnet-42025.09199.91
FORCEArchitecture=Commercial MLLMs, Target Model=Claude-Sonnet-42025.09199.22
FORCEArchitecture=Commercial MLLMs, Target Model=GPT-52025.09199.05
FORCEArchitecture=Adapter-Based MLLMs, Target Model=Llava-v1.6-mistral-7b2025.120.438459.76
FORCEArchitecture=Adapter-Based MLLMs, Target Model=Idefics3-8B-Llama32025.120.359667.49
PGDArchitecture=Adapter-Based MLLMs, Target Model=Llava-v1.6-mistral-7b2025.120.351967.82
PGDArchitecture=Adapter-Based MLLMs, Target Model=Idefics3-8B-Llama32025.120.298171.57
FORCEArchitecture=Adapter-Based MLLMs, Target Model=InstructBlip-Vicuna-7B2025.120.278877.04
PGDArchitecture=Adapter-Based MLLMs, Target Model=InstructBlip-Vicuna-7B2025.120.255879.45
FORCEArchitecture=Commercial MLLMs, Target Model=Gemini-2.5-Pro2025.120.0695.17
PGDArchitecture=Commercial MLLMs, Target Model=Gemini-2.5-Pro2025.120.0496.59
FORCEArchitecture=Early-Fusion MLLMs, Target Model=Qwen2.5-VL-7B-Instruct2025.120.026997.22
FORCEArchitecture=Early-Fusion MLLMs, Target Model=Llama-3.2-11B-Vision-Instruct2025.120.023198.02
PGDArchitecture=Early-Fusion MLLMs, Target Model=Qwen2.5-VL-7B-Instruct2025.120.015498.65
PGDArchitecture=Early-Fusion MLLMs, Target Model=Llama-3.2-11B-Vision-Instruct2025.120.011598.94
PGDArchitecture=Commercial MLLMs, Target Model=Claude-Sonnet-42025.120.0199.91
FORCEArchitecture=Commercial MLLMs, Target Model=Claude-Sonnet-42025.120.0199.22
FORCEArchitecture=Commercial MLLMs, Target Model=GPT-52025.120.0199.05
PGDArchitecture=Commercial MLLMs, Target Model=GPT-52025.120100
PGDArchitecture=Commercial MLLMs, Target Model=GPT-52025.090100