Code Translation on CodeXGLUE Java to C# v1.0 (test)
84.03BLEU-4 ScoreCodeT5-base
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| CodeT5-baseModel size=base2022.07 | 84.03 | 65.9 | |
| CodeT5-largeModel size=large2022.07 | 83.56 | 66 | |
| PLBART2022.07 | 83.02 | 64.6 | |
| CodeT5-smallModel size=small2022.07 | 82.98 | 64.1 | |
| GraphCodeBERT2022.07 | 80.58 | 59.4 | |
| CodeBERT2022.07 | 79.92 | 59 | |
| Roborta (code)2022.07 | 77.46 | 56.1 | |
| Naive copy2022.07 | 18.54 | 0 |