Multimodal Jailbreak Defense on MM-SafetyBench (full) benchmark leaderboard · SOTA2 Research

Multimodal Jailbreak Defense on MM-SafetyBench (full)

1.03ASR (Illegal Activity - S)RAI

Evaluation Results

Method	Links
RAI2026.02		1.03	2.06	0	0	9.09	0	4.59	15.6	18.35	0.61	3.07	3.07	4.17	6.94	9.03	1.3	1.95	3.9	4.71
RAI2026.02		1.03	4.12	2.06	2.27	11.36	2.27	0.92	12.52	9.84	0	1.23	1.84	4.17	8.33	12.5	1.95	1.3	1.3	4.39
shiftDC2026.02		2.78	2.48	9.28	6.82	12.95	22.5	2.48	12.66	17.62	2.39	7.36	13.07	6.25	13.12	18.54	5.65	7.99	15	9.94
Adashield2026.02		4.18	3.71	13.92	10.23	19.43	33.75	3.72	18.99	26.42	3.59	11.04	19.6	9.37	19.69	27.81	8.47	11.98	22.5	14.91
CoCA2026.02		8.35	7.42	27.84	20.46	38.86	67.5	7.43	37.98	52.85	7.18	22.09	39.2	18.75	39.38	55.63	16.95	23.96	45	29.82
ECSO2026.02		8.54	7.59	28.46	20.91	39.73	69	7.6	38.82	54.02	7.34	22.58	40.08	19.16	40.25	56.87	17.32	24.49	46	30.49
shiftDC2026.02		8.66	10.82	21.34	6.82	20.45	25.23	3.03	18.72	19.27	4.42	14.54	17.85	8.12	18.96	20.83	6.82	18.51	22.29	14.82
Original2026.02		9.28	8.25	30.93	22.73	43.18	75	8.26	42.2	58.72	7.98	24.54	43.56	20.83	43.75	61.81	18.83	26.62	50	33.14
Adashield2026.02		12.99	16.24	32.01	10.23	30.68	37.84	4.54	28.08	28.9	6.62	21.81	26.78	12.19	28.44	31.25	10.23	27.76	33.44	22.22
CoCA2026.02		25.98	32.47	64.02	20.46	61.36	75.68	9.08	56.15	57.8	13.25	43.62	53.56	24.37	56.87	62.5	20.46	55.52	66.87	44.45
ECSO2026.02		26.56	33.19	65.44	20.91	62.73	77.36	9.28	57.4	59.08	13.54	44.59	54.75	24.91	58.13	63.88	20.91	56.75	68.36	45.43
Original2026.02		28.87	36.08	71.13	22.73	68.18	84.09	10.09	62.39	64.22	14.72	48.47	59.51	27.08	63.19	69.44	22.73	61.69	74.3	49.38