Method Name Prediction on Py150
99.99RecallFixed
Evaluation results
| Method | Links | ||
|---|---|---|---|
| FixedVictim Model=CodeT5, Defense=KillBadCode2026.02 | 99.99 | 40.42 | |
| GrammarVictim Model=CodeT5, Defense=KillBadCode2026.02 | 99.99 | 39.55 | |
| FixedVictim Model=CodeT5, Defense=ONION2026.02 | 38.67 | 22.34 | |
| GrammarVictim Model=CodeT5, Defense=ONION2026.02 | 34.12 | 19.78 | |
| FixedVictim Model=CodeT5, Defense=SS2026.02 | 32.45 | 19.67 | |
| GrammarVictim Model=CodeT5, Defense=SS2026.02 | 28.92 | 17.84 | |
| AFRAIDOORVictim Model=CodeT5, Defense=KillBadCode2026.02 | 27.2 | 14.4 | |
| STABVictim Model=CodeT5, Defense=KillBadCode2026.02 | 23.02 | 9.77 | |
| AFRAIDOORVictim Model=CodeT5, Defense=ONION2026.02 | 11.45 | 6.78 | |
| AFRAIDOORVictim Model=CodeT5, Defense=SS2026.02 | 8.34 | 5.23 | |
| STABVictim Model=CodeT5, Defense=ONION2026.02 | 5.23 | 3.12 | |
| STABVictim Model=CodeT5, Defense=SS2026.02 | 3.67 | 2.15 |