Method Name Prediction on PyT (test)
81.05ASRSTAB
Evaluation results
| Method | Links | ||
|---|---|---|---|
| STABModel=CodeT5, Surrogate Dataset=PyT2026.02 | 81.05 | 61.25 | |
| STABModel=CodeT5, Surrogate Dataset=CSN2026.02 | 80.91 | 61.25 | |
| AFRAIDOORModel=CodeT5, Surrogate Dataset=PyT2026.02 | 80.69 | 60.53 | |
| STABModel=PLBART, Surrogate Dataset=PyT2026.02 | 79.83 | 54.91 | |
| STABModel=CodeT5, Surrogate Dataset=Py1502026.02 | 79.56 | 61.25 | |
| AFRAIDOORModel=PLBART, Surrogate Dataset=PyT2026.02 | 79.51 | 54.83 | |
| STABModel=PLBART, Surrogate Dataset=CSN2026.02 | 79.48 | 54.91 | |
| STABModel=PLBART, Surrogate Dataset=Py1502026.02 | 78.97 | 54.91 | |
| AFRAIDOORModel=CodeT5, Surrogate Dataset=CSN2026.02 | 78.73 | 60.53 | |
| AFRAIDOORModel=PLBART, Surrogate Dataset=CSN2026.02 | 76.37 | 54.83 | |
| AFRAIDOORModel=CodeT5, Surrogate Dataset=Py1502026.02 | 75.86 | 60.53 | |
| AFRAIDOORModel=PLBART, Surrogate Dataset=Py1502026.02 | 72.34 | 54.83 |