Automatic Security Patch Designing on GHArchive 37 unfixed vulnerabilities after Jan 1st, 2024
78.38Fix Rate@1ChatGPT + SynAT
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ChatGPT + SynATTraining Strategy=In-Context Learning2026.02 | 78.38 | 81.08 | 83.78 | |
| CodeT5 + SynATTraining Strategy=Fine-Tuning2026.02 | 67.57 | 86.49 | 89.19 | |
| ChatGPTTraining Strategy=In-Context Learning2026.02 | 62.16 | 64.86 | 64.86 | |
| CodeT5Training Strategy=Fine-Tuning2026.02 | 40.54 | 54.05 | 54.05 |