Text-to-code generation on mCoNaLa Russian
6.55BLEU-4ERNIE-Code
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| ERNIE-CodeEvaluation Protocol=Translate-train, Max Sequence Length=10242022.12 | 6.55 | 23.84 | 0.09 | |
| ERNIE-CodeEvaluation Protocol=Translate-train, Max Sequence Length=5122022.12 | 6.12 | 25.27 | 0.08 | |
| CodeT5Evaluation Protocol=Translate-train2022.12 | 4.26 | 17.96 | 0.07 | |
| ERNIE-CodeEvaluation Protocol=Zero-shot, Max Sequence Length=5122022.12 | 3.69 | 13.52 | 0.14 | |
| PLBARTEvaluation Protocol=Translate-train2022.12 | 3.27 | 19.92 | 0.09 | |
| mBARTEvaluation Protocol=Translate-train2022.12 | 2.34 | 9.23 | 0.07 | |
| mT5Evaluation Protocol=Translate-train2022.12 | 0.25 | 6.17 | 0.04 |