Method Name Prediction on PyT
100RecallFixed
Evaluation results
| Method | Links | ||
|---|---|---|---|
| FixedVictim Model=CodeT5, Defense=KillBadCode2026.02 | 100 | 42.5 | |
| GrammarVictim Model=CodeT5, Defense=KillBadCode2026.02 | 100 | 41.67 | |
| FixedVictim Model=CodeT5, Defense=ONION2026.02 | 45.67 | 26.34 | |
| GrammarVictim Model=CodeT5, Defense=ONION2026.02 | 40.23 | 23.67 | |
| FixedVictim Model=CodeT5, Defense=SS2026.02 | 38.92 | 22.78 | |
| GrammarVictim Model=CodeT5, Defense=SS2026.02 | 34.67 | 20.45 | |
| AFRAIDOORVictim Model=CodeT5, Defense=KillBadCode2026.02 | 29.3 | 15.6 | |
| STABVictim Model=CodeT5, Defense=KillBadCode2026.02 | 23.97 | 13.28 | |
| AFRAIDOORVictim Model=CodeT5, Defense=ONION2026.02 | 15.89 | 9.78 | |
| AFRAIDOORVictim Model=CodeT5, Defense=SS2026.02 | 11.23 | 7.34 | |
| STABVictim Model=CodeT5, Defense=ONION2026.02 | 7.34 | 4.56 | |
| STABVictim Model=CodeT5, Defense=SS2026.02 | 5.12 | 3.23 |