List your company

Multimodal Jailbreak Defense on MM-SafetyBench (full)

1.03ASR (Illegal Activity - S)RAI
-0.08367.433214.9522.4668Feb 3, 2026

Evaluation results

MethodLinks
RAIBackbone=Qwen2-VL-7B2026.021.032.06009.0904.5915.618.350.613.073.074.176.949.031.31.953.94.71
RAIBackbone=Qwen2.5-VL-7B2026.021.034.122.062.2711.362.270.9212.529.8401.231.844.178.3312.51.951.31.34.39
shiftDCBackbone=Qwen2.5-VL-7B2026.022.782.489.286.8212.9522.52.4812.6617.622.397.3613.076.2513.1218.545.657.99159.94
AdashieldBackbone=Qwen2.5-VL-7B2026.024.183.7113.9210.2319.4333.753.7218.9926.423.5911.0419.69.3719.6927.818.4711.9822.514.91
CoCABackbone=Qwen2.5-VL-7B2026.028.357.4227.8420.4638.8667.57.4337.9852.857.1822.0939.218.7539.3855.6316.9523.964529.82
ECSOBackbone=Qwen2.5-VL-7B2026.028.547.5928.4620.9139.73697.638.8254.027.3422.5840.0819.1640.2556.8717.3224.494630.49
shiftDCBackbone=Qwen2-VL-7B2026.028.6610.8221.346.8220.4525.233.0318.7219.274.4214.5417.858.1218.9620.836.8218.5122.2914.82
OriginalBackbone=Qwen2.5-VL-7B2026.029.288.2530.9322.7343.18758.2642.258.727.9824.5443.5620.8343.7561.8118.8326.625033.14
AdashieldBackbone=Qwen2-VL-7B2026.0212.9916.2432.0110.2330.6837.844.5428.0828.96.6221.8126.7812.1928.4431.2510.2327.7633.4422.22
CoCABackbone=Qwen2-VL-7B2026.0225.9832.4764.0220.4661.3675.689.0856.1557.813.2543.6253.5624.3756.8762.520.4655.5266.8744.45
ECSOBackbone=Qwen2-VL-7B2026.0226.5633.1965.4420.9162.7377.369.2857.459.0813.5444.5954.7524.9158.1363.8820.9156.7568.3645.43
OriginalBackbone=Qwen2-VL-7B2026.0228.8736.0871.1322.7368.1884.0910.0962.3964.2214.7248.4759.5127.0863.1969.4422.7361.6974.349.38