Code Summarization on PyT
100RecallFixed
Evaluation results
| Method | Links | ||
|---|---|---|---|
| FixedVictim Model=CodeT5, Defense=KillBadCode2026.02 | 100 | 37.84 | |
| GrammarVictim Model=CodeT5, Defense=KillBadCode2026.02 | 100 | 36.92 | |
| AFRAIDOORVictim Model=CodeT5, Defense=KillBadCode2026.02 | 26.15 | 12.85 | |
| FixedVictim Model=CodeT5, Defense=ONION2026.02 | 25.34 | 15.23 | |
| FixedVictim Model=CodeT5, Defense=SS2026.02 | 21.67 | 12.89 | |
| GrammarVictim Model=CodeT5, Defense=ONION2026.02 | 21.45 | 12.78 | |
| STABVictim Model=CodeT5, Defense=KillBadCode2026.02 | 20.73 | 9.45 | |
| GrammarVictim Model=CodeT5, Defense=SS2026.02 | 17.89 | 10.67 | |
| AFRAIDOORVictim Model=CodeT5, Defense=ONION2026.02 | 5.78 | 3.45 | |
| AFRAIDOORVictim Model=CodeT5, Defense=SS2026.02 | 4.23 | 2.78 | |
| STABVictim Model=CodeT5, Defense=ONION2026.02 | 2.89 | 1.87 | |
| STABVictim Model=CodeT5, Defense=SS2026.02 | 2.15 | 1.45 |