SciCode
Benchmarks
TaskDatasetSOTA resultTrendResults
SciCode (test)
43.8Subset Accuracy
36
SciCode
0.428Accuracy
18
SciCode
43Accuracy
10
Scicode
57.7Score
8
Scicode
57.7Score
8
SciCode (test)
0.753Mean Spearman Rho
4
SciCode
42.1Pass@1
4
SciCode
35.2Score
3
SciCode subtask
39.6Score (SciCode Reasoning)
1