Code Generation on PCS (test)
97.8Trigger RatePwS
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| PwSDefense Protocol=After Fine-tuning, CWE=202026.05 | 97.8 | 2.8 | |
| PwSDefense Protocol=No Defense, CWE=202026.05 | 97.6 | 2.8 | |
| PwSDefense Protocol=After BEEAR, CWE=202026.05 | 93.4 | 5.5 | |
| PwSDefense Protocol=No Defense, CWE=782026.05 | 90.7 | 22.3 | |
| PwSDefense Protocol=After BEEAR, CWE=782026.05 | 87.8 | 24.2 | |
| PwSDefense Protocol=No Defense, CWE=222026.05 | 85.8 | 13.2 | |
| PwSDefense Protocol=No Defense, CWE=792026.05 | 85.8 | 23.8 | |
| PwSDefense Protocol=After Fine-tuning, CWE=792026.05 | 84.6 | 27 | |
| PwSDefense Protocol=After Fine-tuning, CWE=782026.05 | 82.3 | 41.6 | |
| PwSDefense Protocol=After Fine-tuning, CWE=222026.05 | 81.9 | 13.7 | |
| PwSDefense Protocol=After BEEAR, CWE=222026.05 | 81.8 | 13.5 | |
| PwSDefense Protocol=After BEEAR, CWE=792026.05 | 80.7 | 26.3 | |
| PwSDefense Protocol=No Defense, CWE=892026.05 | 72.4 | 17.2 | |
| PwSDefense Protocol=After Fine-tuning, CWE=892026.05 | 60.2 | 16.5 | |
| PwSDefense Protocol=After BEEAR, CWE=892026.05 | 57.8 | 14.9 |