Text-to-code generation on mCoNaLa Japanese
8.08BLEU-4ERNIE-Code
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| ERNIE-CodeEvaluation Protocol=Translate-train, Max Sequence Length=10242022.12 | 8.08 | 20.12 | 0.09 | |
| ERNIE-CodeEvaluation Protocol=Translate-train, Max Sequence Length=5122022.12 | 8.06 | 22.65 | 0.1 | |
| CodeT5Evaluation Protocol=Translate-train2022.12 | 7.46 | 18.58 | 0.09 | |
| PLBARTEvaluation Protocol=Translate-train2022.12 | 6.56 | 18.26 | 0.09 | |
| mBARTEvaluation Protocol=Translate-train2022.12 | 3.68 | 10.33 | 0.08 | |
| ERNIE-CodeEvaluation Protocol=Zero-shot, Max Sequence Length=5122022.12 | 2.56 | 14.46 | 0.15 | |
| mT5Evaluation Protocol=Translate-train2022.12 | 0.22 | 2.91 | 0.07 |