Code Refinement on CodeXGLUE Code Refinement Small v1.0 (test)
80.02BLEU-4GraphCodeBERT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GraphCodeBERT2022.07 | 80.02 | 17.3 | |
| Naive copy2022.07 | 78.06 | 0 | |
| CoTexT2022.07 | 77.79 | 21.03 | |
| CodeT5-baseModel size=base2022.07 | 77.43 | 21.61 | |
| CodeBERT2022.07 | 77.42 | 16.4 | |
| CodeT5-largeModel size=large2022.07 | 77.38 | 21.7 | |
| Roborta (code)2022.07 | 77.3 | 15.9 | |
| PLBART2022.07 | 77.02 | 19.21 | |
| CodeT5-smallModel size=small2022.07 | 76.23 | 19.06 | |
| NSEdit2022.07 | 71.06 | 24.04 |