Method Name Prediction on Py150 (test)
77.52ASRSTAB
Evaluation results
| Method | Links | ||
|---|---|---|---|
| STABModel=CodeT5, Surrogate Dataset=Py1502026.02 | 77.52 | 53.81 | |
| STABModel=PLBART, Surrogate Dataset=Py1502026.02 | 77.19 | 52.28 | |
| AFRAIDOORModel=CodeT5, Surrogate Dataset=Py1502026.02 | 77.1 | 53.73 | |
| STABModel=PLBART, Surrogate Dataset=CSN2026.02 | 76.86 | 52.28 | |
| STABModel=CodeT5, Surrogate Dataset=CSN2026.02 | 76.77 | 53.81 | |
| STABModel=PLBART, Surrogate Dataset=PyT2026.02 | 76.62 | 52.28 | |
| STABModel=CodeT5, Surrogate Dataset=PyT2026.02 | 76.51 | 53.81 | |
| AFRAIDOORModel=PLBART, Surrogate Dataset=Py1502026.02 | 76.48 | 52.13 | |
| AFRAIDOORModel=CodeT5, Surrogate Dataset=CSN2026.02 | 66.97 | 53.73 | |
| AFRAIDOORModel=PLBART, Surrogate Dataset=CSN2026.02 | 65.64 | 52.13 | |
| AFRAIDOORModel=CodeT5, Surrogate Dataset=PyT2026.02 | 63.54 | 53.73 | |
| AFRAIDOORModel=PLBART, Surrogate Dataset=PyT2026.02 | 63.31 | 52.13 |