Code Summarization on Py150 (test)
81.36ASRSTAB
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| STABModel=CodeT5, Surrogate Dataset=Py1502026.02 | 81.36 | 15.82 | |
| AFRAIDOORModel=CodeT5, Surrogate Dataset=Py1502026.02 | 80.92 | 15.85 | |
| STABModel=PLBART, Surrogate Dataset=Py1502026.02 | 80.72 | 17.09 | |
| AFRAIDOORModel=PLBART, Surrogate Dataset=Py1502026.02 | 80.27 | 16.87 | |
| STABModel=CodeT5, Surrogate Dataset=CSN2026.02 | 79.83 | 15.82 | |
| STABModel=PLBART, Surrogate Dataset=CSN2026.02 | 79.38 | 17.09 | |
| STABModel=CodeT5, Surrogate Dataset=PyT2026.02 | 79.21 | 15.82 | |
| STABModel=PLBART, Surrogate Dataset=PyT2026.02 | 78.86 | 17.09 | |
| AFRAIDOORModel=CodeT5, Surrogate Dataset=PyT2026.02 | 68.51 | 15.85 | |
| AFRAIDOORModel=CodeT5, Surrogate Dataset=CSN2026.02 | 68.17 | 15.85 | |
| AFRAIDOORModel=PLBART, Surrogate Dataset=CSN2026.02 | 67.4 | 16.87 | |
| AFRAIDOORModel=PLBART, Surrogate Dataset=PyT2026.02 | 66.32 | 16.87 |