Text-to-code generation on mCoNaLa Spanish
2.51BLEU-4ERNIE-Code
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ERNIE-CodeEvaluation Protocol=Translate-train, Max Sequence Length=10242022.12 | 2.51 | 12.65 | 6 | |
| ERNIE-CodeEvaluation Protocol=Zero-shot, Max Sequence Length=5122022.12 | 2.47 | 12.12 | 10 | |
| ERNIE-CodeEvaluation Protocol=Translate-train, Max Sequence Length=5122022.12 | 2.25 | 14.92 | 6 | |
| PLBARTEvaluation Protocol=Translate-train2022.12 | 2.19 | 14.47 | 6 | |
| CodeT5Evaluation Protocol=Translate-train2022.12 | 1.97 | 14.47 | 5 | |
| mBARTEvaluation Protocol=Translate-train2022.12 | 1.73 | 11.85 | 5 | |
| mT5Evaluation Protocol=Translate-train2022.12 | 0.27 | 3.51 | 5 |