Code Refinement on Code Refinement medium (test)
91.31BLEU ScoreGraphCodeBERT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GraphCodeBERT2020.09 | 91.31 | 9.1 | |
| CodeBERT2020.09 | 91.07 | 5.2 | |
| Naive2020.09 | 90.91 | 0 | |
| RoBERTa (code)2020.09 | 90.07 | 4.1 | |
| Transformer2020.09 | 89.25 | 3.7 | |
| LSTM2020.09 | 72.08 | 2.5 |