Bug-finding on OSV
10Reproduced Bugs RateCLAUDE CODE
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| CLAUDE CODEBacking Model=Claude2026.06 | 10 | 26 | 36 | 61 | |
| CODE-AUGURBacking Model=DeepSeek2026.06 | 9 | 40 | 49 | — | |
| ATLANTISBacking Model=Claude2026.06 | 9 | 20 | 29 | 86 | |
| CODE-AUGURBacking Model=Claude2026.06 | 8 | 50 | 58 | — | |
| ATLANTISBacking Model=DeepSeek2026.06 | 8 | 2 | 10 | 370 | |
| CLAUDE CODEBacking Model=DeepSeek2026.06 | 8 | 11 | 19 | 157 |