Malicious Code Generation on RMCBench benchmark leaderboard · SOTA2 Research

Malicious Code Generation on RMCBench

92.86Attack Success Rate (ASR)CodeSpear

Evaluation Results

Method	Links
CodeSpear2026.06		92.86	75.64
CodeJailbreaker2026.06		89.93	51.65
CodeSpear2026.06		85.53	63.37
CodeSpear2026.06		82.78	62.09
Vanilla-T2026.06		81.67	60.67
CodeSpear2026.06		80.95	67.77
CodeJailbreaker2026.06		78.21	65.75
CodeJailbreaker2026.06		76.37	45.79
Vanilla2026.06		74.18	47.62
CodeJailbreaker2026.06		69.6	56.78
PAIR2026.06		67.22	25.64
PAIR2026.06		66.12	21.79
PAIR2026.06		64.84	23.44
Vanilla2026.06		64.47	46.15
Vanilla-T2026.06		64	59.33
DAN2026.06		63.37	54.76
CodeSpear2026.06		63.37	38.83
Vanilla2026.06		60.26	36.45
CodeJailbreaker2026.06		60.26	39.74
Vanilla2026.06		59.89	45.6
PAIR2026.06		59.52	19.23
DAN2026.06		58.24	41.58
DAN2026.06		55.13	41.03
Vanilla-T2026.06		53.67	46
DAN2026.06		53.66	40.66
Vanilla-T2026.06		45	30.67
LRL2026.06		41.94	17.58
APT2026.06		39.93	11.36
LRL2026.06		38.28	12.45
LRL2026.06		36.08	12.82
APT2026.06		34.8	8.24
APT2026.06		29.85	7.14
Vanilla2026.06		26.92	23.26
APT2026.06		25.27	2.56
LRL2026.06		23.81	6.41
PAIR2026.06		21.79	8.24
APT2026.06		18.32	4.03
LRL2026.06		11.72	1.1
Vanilla-T2026.06		10	7.33
DAN2026.06		0.92	0.92