Code Refinement on Refine medium (test)
92.7ASRsPLBART
Evaluation results
| Method | Links | ||
|---|---|---|---|
| PLBARTAttack=insert, Backdoor=true2023.06 | 92.7 | 4.68 | |
| CodeT5Attack=delete, Backdoor=true2023.06 | 86.45 | 5.04 | |
| PLBARTAttack=delete, Backdoor=true2023.06 | 73.41 | 6.1 | |
| CodeT5Attack=operator, Backdoor=true2023.06 | 66.56 | 6.15 | |
| CodeT5Attack=insert, Backdoor=true2023.06 | 64.31 | 3.57 | |
| PLBARTAttack=operator, Backdoor=true2023.06 | 62.59 | 5.75 |