Multilingual code summarization on mCoNaLa translated English
131BLEU-4ERNIE-Code
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| ERNIE-CodeEvaluation Protocol=Zero-shot, Maximum length=5122022.12 | 131 | 25.1 | 12.8 | |
| ERNIE-CodeEvaluation Protocol=Translate-train, Maximum length=10242022.12 | 112 | 16.04 | 16.02 | |
| ERNIE-CodeEvaluation Protocol=Translate-train, Maximum length=5122022.12 | 88 | 16.05 | 16.33 | |
| CodeT5Evaluation Protocol=Translate-train2022.12 | 39 | 9.94 | 13.4 | |
| mBARTEvaluation Protocol=Translate-train2022.12 | 37 | 8.05 | 13.58 | |
| mT5Evaluation Protocol=Translate-train2022.12 | 36 | 11.4 | 12.82 | |
| PLBARTEvaluation Protocol=Translate-train2022.12 | 15 | 7.14 | 11.22 |