Method Name Prediction on CSN
100RecallFixed
Evaluation results
| Method | Links | ||
|---|---|---|---|
| FixedVictim Model=CodeT5, Defense=KillBadCode2026.02 | 100 | 45.13 | |
| GrammarVictim Model=CodeT5, Defense=KillBadCode2026.02 | 100 | 43.87 | |
| FixedVictim Model=CodeT5, Defense=ONION2026.02 | 42.34 | 24.78 | |
| GrammarVictim Model=CodeT5, Defense=ONION2026.02 | 37.89 | 22.12 | |
| FixedVictim Model=CodeT5, Defense=SS2026.02 | 35.78 | 21.34 | |
| GrammarVictim Model=CodeT5, Defense=SS2026.02 | 31.45 | 19.23 | |
| AFRAIDOORVictim Model=CodeT5, Defense=KillBadCode2026.02 | 25.4 | 12.2 | |
| STABVictim Model=CodeT5, Defense=KillBadCode2026.02 | 21.25 | 8.64 | |
| AFRAIDOORVictim Model=CodeT5, Defense=ONION2026.02 | 13.78 | 8.34 | |
| AFRAIDOORVictim Model=CodeT5, Defense=SS2026.02 | 9.67 | 6.12 | |
| STABVictim Model=CodeT5, Defense=ONION2026.02 | 6.45 | 3.89 | |
| STABVictim Model=CodeT5, Defense=SS2026.02 | 4.23 | 2.67 |