Code Translation on XLCoST Program-level original (test) benchmark leaderboard · SOTA2 Research

Code Translation on XLCoST Program-level original (test)

84.4CodeBLEU (C++ to Java)CodeGeeX

Updated 5mo ago

Evaluation Results

Method	Links
CodeGeeX2023.03		84.4	73.89	84.49	82.2	71.18	87.32	87.07	73.11	91.78	84.34	70.61	81.07	82.59	82.49	80.01	77.47	68.91	71.67	87.11	90.46	72.89	83.83	70.58	80.73	85.84	83.85	72.11	85.35	69.8	79.41	87.23	83.9	71.02	85.34	82.81	78.76	88.21	82.46	69.78	85.56	81.21	68.8
CodeT52023.03		80.03	71.56	81.73	79.48	70.44	85.67	84.26	69.57	87.79	80.67	69.44	78.78	78.85	73.15	73.35	71.8	67.5	56.35	83.59	85.7	69.52	80.5	69.63	77.35	82.14	79.91	68.42	81.77	68.76	74.57	85.55	82.09	72.26	83.79	81.72	65.86	88.17	76.12	56.32	80.2	76.5	64.28
PLBART2023.03		75.26	70.13	78.01	61.85	67.01	72.59	81.41	66.29	83.34	80.14	67.12	63.37	74.38	67.8	66.03	69.3	64.85	29.05	80.17	81.37	67.02	79.81	67.12	57.6	80.19	76.96	64.18	78.51	67.24	67.7	79.4	72.77	61.26	74.16	44.26	56.23	78.42	13.45	5.53	45.15	31.47	25.17
CodeBERT2023.03		74.73	24.96	76.35	72.95	50.4	21.84	79.36	8.51	84.43	76.02	51.42	21.22	68.87	28.22	17.8	23.65	49.3	18.32	78.52	82.25	10.82	75.46	51.76	21.63	75.43	72.33	9.19	75.47	52.08	19.79	50.13	46.81	16.92	49.75	48.12	22.19	21.7	21.27	21.1	19.5	15.64	31.71