Code Translation on XLCoST Snippet-level original (test) benchmark leaderboard · SOTA2 Research

Code Translation on XLCoST Snippet-level original (test)

86.99C++ -> Java CodeBLEUCodeGeeX

Updated 5mo ago

Evaluation Results

Method	Links
CodeGeeX2023.03		86.99	74.73	86.63	84.83	70.3	94.04	89.08	74.65	92.94	86.96	69.77	88.44	82.91	81.93	81.3	79.83	67.99	82.59	88.7	93.03	74.55	86.44	69.49	86.69	86.72	86.96	73.25	86.41	69	83.85	86.75	86.24	71.37	85.58	84.17	83.89	91.3	85.58	71.52	87.52	84.91	68.52
CodeT52023.03		86.35	76.28	85.85	84.31	69.87	90.45	88.26	74.59	92.56	86.22	69.02	82.78	81.56	78.61	78.89	77.76	67.54	68.67	88.06	91.69	73.85	85.95	68.97	81.09	85.06	85.48	73.15	85.96	68.42	80.49	86.33	85.12	73.22	84.56	83.56	79.3	90.26	81.81	63.81	83.05	79.73	66.32
CodeBERT2023.03		84.84	74.55	84.99	82.79	68.56	45.46	87.27	58.39	92.26	84.63	67.26	39.94	80.46	58.5	54.72	57.38	65.14	10.7	86.96	90.15	56.92	84.38	67.18	40.43	84.38	84.42	52.57	84.74	66.66	33.29	82.58	81.57	69.29	80.96	79.94	28.45	45.84	39.69	13.55	39.71	29.85	38.88
PLBART2023.03		83.85	74.89	84.57	83.19	68.62	83.95	87.31	58.3	90.78	85.42	67.44	72.47	80.15	74.15	73.5	73.2	66.12	62.15	84.98	86.27	69.82	85.02	67.3	75.74	84.45	84.9	69.29	85.05	67.09	72.65	83.87	81.66	71.17	78	82.94	57.39	82.53	72.35	49.16	75.78	75.05	60.86