CodeNet
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
CodeNet D152 (evaluation)
100Accuracy
36
CodeNet D88 (evaluation)
100Accuracy
36
CodeNet D56 (evaluation)
100Accuracy
36
CodeNet D40 (evaluation)
100Accuracy
36
CodeNet D32 (evaluation)
100Accuracy
36
CodeNet (test)
240.8Overall MAE
18
CodeNet
93.6Computational Accuracy (C)
11
CodeNet
2.28Average Metric Rank
9
CodeNet Python800 (test)
0.013Error Rate
7
CodeNet Java250 (test)
1.56Error Rate
7
CodeNet Python800 1.0 (test)
86.01MAP@R
6
CodeNet Java250 1.0 (test)
86.74MAP@R
6
CodeNet C++1000 (test)
6.18Error Rate
4
CodeNet C++1000 1.0 (test)
60.21MAP@R
4
CodeNet
79.13MAP
4
CodeNet D32 n=250
100Extraction Rate (No Attack)
3