Code Summarization on CSN
100RecallFixed
Evaluation results
| Method | Links | ||
|---|---|---|---|
| FixedVictim Model=CodeT5, Defense=KillBadCode2026.02 | 100 | 39.76 | |
| GrammarVictim Model=CodeT5, Defense=KillBadCode2026.02 | 100 | 38.92 | |
| AFRAIDOORVictim Model=CodeT5, Defense=KillBadCode2026.02 | 22.73 | 10.54 | |
| FixedVictim Model=CodeT5, Defense=ONION2026.02 | 22.67 | 13.45 | |
| GrammarVictim Model=CodeT5, Defense=ONION2026.02 | 18.92 | 11.23 | |
| STABVictim Model=CodeT5, Defense=KillBadCode2026.02 | 18.45 | 6.92 | |
| FixedVictim Model=CodeT5, Defense=SS2026.02 | 18.34 | 11.23 | |
| GrammarVictim Model=CodeT5, Defense=SS2026.02 | 14.67 | 9.45 | |
| AFRAIDOORVictim Model=CodeT5, Defense=ONION2026.02 | 4.56 | 2.89 | |
| AFRAIDOORVictim Model=CodeT5, Defense=SS2026.02 | 3.12 | 2.15 | |
| STABVictim Model=CodeT5, Defense=ONION2026.02 | 2.34 | 1.56 | |
| STABVictim Model=CodeT5, Defense=SS2026.02 | 1.67 | 1.12 |