Vulnerability Detection Evasion on C/C++ Vulnerability Detection Dataset
4.72ASR (Identifier Sub.)CodeAstra
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| CodeAstraAttack Regime=Surrogate Transfer, Surrogate Model=Qwen2.5-Coder-14B2026.01 | 4.72 | 78.6 | 42.59 | 75.48 | 72.12 | |
| GPT-5-miniAttack Regime=Surrogate Transfer, Surrogate Model=Qwen2.5-Coder-14B2026.01 | 10.62 | 18.34 | 28.14 | 21.57 | 17.58 | |
| Qwen2.5-Coder-32BAttack Regime=Surrogate Transfer, Surrogate Model=Qwen2.5-Coder-14B2026.01 | 26.94 | 91.53 | 98.84 | 85.81 | 63.15 | |
| GPT-4oAttack Regime=Surrogate Transfer, Surrogate Model=Qwen2.5-Coder-14B2026.01 | 31.09 | 65.48 | 71.61 | 42.35 | 19.09 | |
| Llama3.1-8BAttack Regime=Surrogate Transfer, Surrogate Model=Qwen2.5-Coder-14B2026.01 | 34.66 | 64.5 | 99.03 | 96.33 | 59.79 |