Multilingual code summarization on mCoNaLa Russian (test)
1.98BLEU-4ERNIE-Code
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ERNIE-CodeEvaluation Protocol=Zero-shot, Maximum length=5122022.12 | 1.98 | 30.46 | 11.68 | |
| ERNIE-CodeEvaluation Protocol=Translate-train, Maximum length=5122022.12 | 0.43 | 5.01 | 16.6 | |
| ERNIE-CodeEvaluation Protocol=Translate-train, Maximum length=10242022.12 | 0.28 | 5.69 | 15.24 | |
| PLBARTEvaluation Protocol=Translate-train2022.12 | 0.24 | 2.98 | 14.06 | |
| CodeT5Evaluation Protocol=Translate-train2022.12 | 0.13 | 1.48 | 12.97 | |
| mT5Evaluation Protocol=Translate-train2022.12 | 0.09 | 2.56 | 12 | |
| mBARTEvaluation Protocol=Translate-train2022.12 | 0.08 | 0 | 13.56 |