Code Refinement on CodeXGLUE Code Refinement (Medium) v1.0 (test)
91.31BLEU-4GraphCodeBERT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GraphCodeBERT2022.07 | 91.31 | 9.1 | |
| CodeBERT2022.07 | 91.07 | 5.2 | |
| Naive copy2022.07 | 90.91 | 0 | |
| Roborta (code)2022.07 | 90.07 | 4.1 | |
| CodeT5-largeModel size=large2022.07 | 89.22 | 14.76 | |
| CodeT5-smallModel size=small2022.07 | 89.2 | 10.92 | |
| PLBART2022.07 | 88.5 | 8.98 | |
| CoTexT2022.07 | 88.4 | 13.11 | |
| CodeT5-baseModel size=base2022.07 | 87.64 | 13.96 | |
| NSEdit2022.07 | 85.72 | 13.87 |