Exploit Generation on RCE vulnerabilities input level 5 benchmark leaderboard · SOTA2 Research

Exploit Generation on RCE vulnerabilities input level 5

18.53Total ScoreGPT-o3

Evaluation Results

Method	Links
GPT-o32026.06		18.53	81	11	3.94	1.17	2.52	3.22	3.59	3.16
o32026.06		16.96	79	15	3.56	1.06	2.28	2.79	3.31	2.99
GPT-5.22026.06		16.84	66	17	3.17	1.2	2.22	3.13	3.47	2.83
Qwen3-235B2026.06		16.12	36	0	3.91	1	2.28	3.23	2.65	2.53
Claude Sonnet 4.52026.06		15.77	65	3	3.17	1.06	2.25	3.02	2.8	2.8
Claude Sonnet 3.72026.06		15.23	64	2	3.37	1.09	2.21	2.53	3.07	2.56
Qwen3-Coder-480B2026.06		15.19	52	0	3.71	0.91	2.17	2.76	2.76	2.26
DeepSeek-V3.22026.06		15.18	69	5	3.47	1	2.13	2.64	2.66	2.33
Kimi-K2.52026.06		15.09	56	4	3.57	1	2.16	3.17	2.84	2.76
DeepSeek-R12026.06		15.08	55	1	3.12	0.93	2.19	2.98	2.65	2.61
Qwen3-30B2026.06		14.86	37	0	3.69	0.96	2.17	2.85	2.56	2.27
Kimi-K2.52026.06		14.54	50	12	3.39	1	2.02	2.36	2.57	2.59
Claude Opus 4.62026.06		14.37	68	14	2.85	1.03	1.96	2.37	2.49	2.84
Claude Opus 4.62026.06		14.25	73	6	2.84	1	2.01	2.97	2.74	2.8
Qwen3-8B2026.06		13.53	42	0	3.49	0.72	1.98	2.68	2.16	2.06
DeepSeek-R12026.06		13.04	53	7	3.22	0.89	1.8	2.22	2.27	2
Llama4-Maverick-400B2026.06		12.46	36	0	3.34	0.73	1.91	2	2.07	2.13
GPT-4o2026.06		12.33	48	0	3.3	0.74	1.87	1.87	2.24	1.83
Llama4-Scout-109B2026.06		12.25	36	1	3.25	0.65	1.9	1.9	2.1	2.15
Qwen3-235B2026.06		12.21	33	6	3.08	0.82	1.67	2.36	1.97	1.91
Qwen3-14B2026.06		9.84	21	0	2.42	0.54	1.37	2.21	1.37	1.49
Qwen3-8B2026.06		9.38	48	2	2.8	0.64	1.18	1.47	1.76	1.03
GPT-52026.06		7.64	28	13	1.09	0.44	0.87	2.26	1.25	1.32
Llama4-Maverick-400B2026.06		7.36	20	0	2.09	0.42	1.04	1.21	1.11	1.26
Qwen3-8B2026.06		6.58	20	0	1.93	0.37	0.9	1.31	1.04	0.77