Code Summarization on PyT (test)
84.76ASRSTAB
Evaluation results
| Method | Links | ||
|---|---|---|---|
| STABModel=PLBART, Surrogate Dataset=PyT2026.02 | 84.76 | 11.24 | |
| STABModel=CodeT5, Surrogate Dataset=CSN2026.02 | 83.86 | 11.45 | |
| STABModel=CodeT5, Surrogate Dataset=PyT2026.02 | 83.77 | 11.45 | |
| STABModel=PLBART, Surrogate Dataset=CSN2026.02 | 83.52 | 11.24 | |
| STABModel=PLBART, Surrogate Dataset=Py1502026.02 | 82.72 | 11.24 | |
| AFRAIDOORModel=CodeT5, Surrogate Dataset=PyT2026.02 | 82.7 | 11.37 | |
| AFRAIDOORModel=PLBART, Surrogate Dataset=PyT2026.02 | 82.47 | 10.97 | |
| STABModel=CodeT5, Surrogate Dataset=Py1502026.02 | 82.41 | 11.45 | |
| AFRAIDOORModel=PLBART, Surrogate Dataset=CSN2026.02 | 78.36 | 10.97 | |
| AFRAIDOORModel=CodeT5, Surrogate Dataset=CSN2026.02 | 77.48 | 11.37 | |
| AFRAIDOORModel=CodeT5, Surrogate Dataset=Py1502026.02 | 74.62 | 11.37 | |
| AFRAIDOORModel=PLBART, Surrogate Dataset=Py1502026.02 | 74.28 | 10.97 |