Malicious code generation audit on Innoc2Scam-bench (Total)
1,377Promptsgemini-2.5-pro
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| gemini-2.5-pro2025.09 | 1,377 | 799 | 553 | 178 | 12.9 | 22.28 | 40.16 | |
| gpt-52025.09 | 1,377 | 1,227 | 24 | 303 | 22 | 24.69 | 1.74 | |
| claude-sonnet-42025.09 | 1,377 | 1,248 | 115 | 472 | 34.3 | 37.82 | 8.35 | |
| grok-code-fast-12025.09 | 1,377 | 1,355 | 18 | 597 | 43.4 | 44.06 | 1.31 | |
| gemini-2.5-flash2025.09 | 1,377 | 1,351 | 1 | 612 | 44.4 | 45.3 | 0.07 | |
| qwen3-coder2025.09 | 1,377 | 1,367 | 3 | 628 | 45.6 | 45.94 | 0.22 | |
| deepseek-chat-v3.12025.09 | 1,377 | 1,358 | 12 | 651 | 47.3 | 47.94 | 0.87 |