List your company
ResearchFormerly WizWand

Text-to-code generation on mCoNaLa Japanese

8.08BLEU-4ERNIE-Code
-0.09442.02784.156.2722Dec 13, 2022
Updated 8mo ago

Evaluation results

MethodLinks
ERNIE-CodeEvaluation Protocol=Translate-train, Max Sequence Length=10242022.128.0820.120.09
ERNIE-CodeEvaluation Protocol=Translate-train, Max Sequence Length=5122022.128.0622.650.1
CodeT5Evaluation Protocol=Translate-train2022.127.4618.580.09
PLBARTEvaluation Protocol=Translate-train2022.126.5618.260.09
mBARTEvaluation Protocol=Translate-train2022.123.6810.330.08
ERNIE-CodeEvaluation Protocol=Zero-shot, Max Sequence Length=5122022.122.5614.460.15
mT5Evaluation Protocol=Translate-train2022.120.222.910.07