Code Summarization on Py150
100RecallFixed
Evaluation results
| Method | Links | ||
|---|---|---|---|
| FixedVictim Model=CodeT5, Defense=KillBadCode2026.02 | 100 | 35.28 | |
| GrammarVictim Model=CodeT5, Defense=KillBadCode2026.02 | 100 | 34.85 | |
| AFRAIDOORVictim Model=CodeT5, Defense=KillBadCode2026.02 | 24.15 | 11.92 | |
| STABVictim Model=CodeT5, Defense=KillBadCode2026.02 | 19.87 | 7.65 | |
| FixedVictim Model=CodeT5, Defense=ONION2026.02 | 19.34 | 11.67 | |
| FixedVictim Model=CodeT5, Defense=SS2026.02 | 15.82 | 9.45 | |
| GrammarVictim Model=CodeT5, Defense=ONION2026.02 | 15.78 | 9.45 | |
| GrammarVictim Model=CodeT5, Defense=SS2026.02 | 12.34 | 7.82 | |
| AFRAIDOORVictim Model=CodeT5, Defense=ONION2026.02 | 3.67 | 2.34 | |
| AFRAIDOORVictim Model=CodeT5, Defense=SS2026.02 | 2.45 | 1.78 | |
| STABVictim Model=CodeT5, Defense=ONION2026.02 | 1.89 | 1.23 | |
| STABVictim Model=CodeT5, Defense=SS2026.02 | 1.23 | 0.89 |