Vulnerability Detection on CWE-Bench-Java 120 vulnerabilities (full)
78Detected CountvEcho
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| vEchoconfiguration=Full System2026.03 | 78 | 65 | 59.78 | 42.2 | |
| IRISmode=SOTA LLM-assisted2026.03 | 55 | 45.83 | 84.82 | 17.7 | |
| Vanilla LLMmode=unassisted2026.03 | 34 | 28.33 | 86.45 | 22 | |
| SATS Toolsusage=industrial practice2026.03 | 29 | 24.17 | 94.16 | 6.3 |