Code Generation Security on Python Code Generation Security Dataset 75 cases
55Baseline Control RateGemini-3-Flash-Preview
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Gemini-3-Flash-Preview2026.05 | 55 | 81.8 | 13.3 | 56.4 | 32 | 94.4 | 4.1 | |
| GPT-5.2-chat2026.05 | 54 | 85.2 | 10.7 | 57.4 | 30.7 | 98.1 | 1.4 | |
| GPT-5.1-chat2026.05 | 49 | 85.7 | 9.3 | 61.2 | 25.3 | 91.7 | 5.4 | |
| DeepSeek-V3.22026.05 | 37 | 83.3 | 8.2 | 61.1 | 19.2 | 97.2 | 1.4 |