Code Summarization on CSN (test)
97.33ASRSTAB
Evaluation results
| Method | Links | ||
|---|---|---|---|
| STABModel=CodeT5, Surrogate Dataset=CSN2026.02 | 97.33 | 14.04 | |
| STABModel=PLBART, Surrogate Dataset=CSN2026.02 | 97.08 | 12.72 | |
| STABModel=PLBART, Surrogate Dataset=PyT2026.02 | 96.79 | 12.72 | |
| AFRAIDOORModel=CodeT5, Surrogate Dataset=CSN2026.02 | 96.47 | 13.95 | |
| AFRAIDOORModel=PLBART, Surrogate Dataset=CSN2026.02 | 96.33 | 12.76 | |
| STABModel=CodeT5, Surrogate Dataset=PyT2026.02 | 96.29 | 14.04 | |
| STABModel=PLBART, Surrogate Dataset=Py1502026.02 | 96.03 | 12.72 | |
| STABModel=CodeT5, Surrogate Dataset=Py1502026.02 | 95.67 | 14.04 | |
| AFRAIDOORModel=CodeT5, Surrogate Dataset=PyT2026.02 | 94.13 | 13.95 | |
| AFRAIDOORModel=PLBART, Surrogate Dataset=PyT2026.02 | 93.97 | 12.76 | |
| AFRAIDOORModel=CodeT5, Surrogate Dataset=Py1502026.02 | 90.54 | 13.95 | |
| AFRAIDOORModel=PLBART, Surrogate Dataset=Py1502026.02 | 89.69 | 12.76 |