Vulnerability Discovery on 20 COM objects benchmark leaderboard · SOTA2 Research

Vulnerability Discovery on 20 COM objects

100C01Codex

Evaluation Results

Method	Links
Codex2026.05		100	100	100	100	100	100	100	100	100	80	100	100	67	94	80	100	100	100	100	100	96	97
Slyp2026.05		80	100	100	100	100	100	100	100	100	100	100	100	67	100	100	100	100	100	100	100	97.3	98.5
Codex2026.05		80	100	100	84	100	100	100	100	100	80	100	100	67	94	100	100	100	100	100	100	95.3	94.8
Slyp2026.05		80	100	100	100	100	100	100	100	100	80	100	100	67	100	100	100	100	100	100	100	96.3	97.7
Slyp2026.05		80	100	100	86	67	100	100	100	80	80	80	100	67	100	100	100	100	100	100	100	92	93.7
Codex2026.05		80	100	100	100	100	100	100	89	80	100	80	100	100	71	0	100	100	100	100	100	90	91.2
Slyp2026.05		80	100	100	100	100	100	100	100	100	80	100	100	67	100	100	86	100	100	100	100	95.6	97
Cc2026.05		80	100	100	100	100	100	100	100	100	50	100	100	100	100	80	67	100	100	100	100	93.8	95.4
Slyp2026.05		80	100	100	100	100	100	100	100	100	80	100	100	67	100	80	86	100	100	100	100	94.6	96.2
Cc2026.05		80	100	100	84	100	100	100	100	100	50	100	100	67	100	100	67	100	100	100	100	92.4	93.2
Slyp2026.05		50	100	100	62	100	100	100	89	80	67	80	100	0	0	0	67	100	100	50	80	71.2	74.3
Cc2026.05		33	0	100	67	67	100	75	57	50	0	80	100	0	0	0	100	100	0	0	80	50.4	60.4