C++
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
C++
100Syntactic Correctness
100
C++_5
86Acc
72
C++ (test)
100Safe Code Rate
66
C++
64.07Relative Inference Time
40
C++
43.9Success Rate U
20
C++
1.42Mean Generation Latency (s)
9
C++
100Decoupling Probability
9