Multilingual Code Summarization on mCoNaLa Japanese translated English
1.46BLEU-4ERNIE-Code
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ERNIE-CodeEvaluation Protocol=Zero-shot, Maximum length=5122022.12 | 1.46 | 32.07 | 11.02 | |
| ERNIE-CodeEvaluation Protocol=Translate-train, Maximum length=10242022.12 | 0.58 | 8.55 | 8.81 | |
| ERNIE-CodeEvaluation Protocol=Translate-train, Maximum length=5122022.12 | 0.3 | 10.62 | 9.16 | |
| mBARTEvaluation Protocol=Translate-train2022.12 | 0.07 | 4.7 | 7.88 | |
| mT5Evaluation Protocol=Translate-train2022.12 | 0.06 | 2.95 | 6.58 | |
| PLBARTEvaluation Protocol=Translate-train2022.12 | 0.06 | 4.11 | 7.87 | |
| CodeT5Evaluation Protocol=Translate-train2022.12 | 0.04 | 5.42 | 7.13 |