CrossCodeEval
Benchmarks
TaskDatasetSOTA resultTrendResults
CrossCodeEval (test)
49.3Python EM
20
CrossCodeEval C# (test)
75.38Code ES
13
CrossCodeEval TypeScript (test)
70.31Code ES
13
CrossCodeEval Java (test)
74.92Code ES
13
CrossCodeEval Python (test)
78.78Code ES
13
CrossCodeEval (test)
35.9Python EM
5
CrossCodeEval
35.9Python EM
5
CrossCodeEval Project-level (test)
9.08C-EM
4