Code Refinement on Refine small (test)
80.1ASRsCodeT5
Evaluation results
| Method | Links | ||
|---|---|---|---|
| CodeT5Attack=delete, Backdoor=true2023.06 | 80.1 | 18.51 | |
| PLBARTAttack=delete, Backdoor=true2023.06 | 72.61 | 9.03 | |
| PLBARTAttack=insert, Backdoor=true2023.06 | 69.13 | 10.66 | |
| CodeT5Attack=insert, Backdoor=true2023.06 | 66.24 | 9.9 | |
| CodeT5Attack=operator, Backdoor=true2023.06 | 38.08 | 8.22 | |
| PLBARTAttack=operator, Backdoor=true2023.06 | 36.77 | 9.74 |