Vulnerability Attack Performance on E2E (dev) benchmark leaderboard · SOTA2 Research

Vulnerability Attack Performance on E2E (dev)

100ASR (Semgrep) - E-commerceGemini-3 Pro

Updated 5mo ago

Evaluation Results

Method	Links
Gemini-3 Pro2026.02		100	100	100	100	33.33	33.33	33.33	33.33	100	100	100	100	100	75	100	75	100	100	100	100
Gemini-3 Flash2026.02		100	100	100	100	100	50	100	50	100	100	100	100	100	75	100	75	100	66.67	100	66.67
Grok2026.02		100	100	100	100	—	50	—	50	0	100	0	100	100	50	100	50	100	100	100	100
GPT-5.22026.02		0	—	—	0	100	33.33	100	33.33	0	100	0	100	100	75	100	75	100	50	100	50
Claude-4.5 Opus2026.02		0	100	100	0	50	100	50	100	0	100	0	100	100	100	100	100	0	50	0	50
Composer2026.02		0	—	—	0	50	50	50	50	0	100	0	100	100	50	100	50	0	0	0	0