CodeXGLUE
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
CodeXGLUE
20.83Java Score
38
CodeXGLUE
0.534Defect Rate
21
CodeXGLUE
15.7Repair Rate
21
CodeXGLUE
95.7Clone Score
21
CodeXGLUE Defect Detection (test)
3.92# Identifiers
18
CodeXGLUE Clone Detection
83.19ASR
18
CodeXGLUE Defect Detection
99.89ASR
18
CodeXGLUE (test)
65.8Accuracy
18
CodeXGLUE Code-Text
13.21BLEU-4
12
CodeXGLUE Java (test)
22.95BLEU-4
11
CodeXGLUE Python (test)
21.01BLEU-4
11
CodeXGLUE Python (test)
21.99BLEU
11
CodeXGLUE Python (test)
31.98CodeBLEU
10
CodeXGLUE Code Refinement (Medium) v1.0 (test)
91.31BLEU-4
10
CodeXGLUE Code Refinement Small v1.0 (test)
80.02BLEU-4
10
CodeXGLUE AdvTest
44.7MRR
9
CodeXGLUE (test)
22.65EM
9
CodeXGLUE Java (test)
38.12CodeBLEU
8
CodeXGLUE Clone Detection (test)
96.7Recall
8
CodeXGLUE C# to Java v1.0 (test)
79.87BLEU-4
8
CodeXGLUE Java to C# v1.0 (test)
84.03BLEU-4 Score
8
CodeXGLUE (test)
20.57Python
8
CodeXGLUE (test)
20.63Overall Score
7
CodeXGLUE
52.87Precision
6
CodeXGLUE
46.3Code Refinement Score
6