Text-to-code generation on mCoNaLa Average
5.71BLEU-4ERNIE-Code
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ERNIE-CodeEvaluation Protocol=Translate-train, Max Sequence Length=10242022.12 | 5.71 | 18.87 | 0.08 | |
| ERNIE-CodeEvaluation Protocol=Translate-train, Max Sequence Length=5122022.12 | 5.48 | 20.95 | 0.08 | |
| CodeT5Evaluation Protocol=Translate-train2022.12 | 4.56 | 17 | 0.07 | |
| PLBARTEvaluation Protocol=Translate-train2022.12 | 4.01 | 17.55 | 0.08 | |
| ERNIE-CodeEvaluation Protocol=Zero-shot, Max Sequence Length=5122022.12 | 2.91 | 13.37 | 0.13 | |
| mBARTEvaluation Protocol=Translate-train2022.12 | 2.58 | 10.47 | 0.07 | |
| mT5Evaluation Protocol=Translate-train2022.12 | 0.25 | 4.2 | 0.05 |