Code Generation
Benchmarks
DatasetSOTA methodMetricTrendResultsLast updated
74.1Accuracy
31
May 13, 2026
1,796.9TPS (Tokens/s)
31
Jun 2, 2026
72.1Accuracy
31
Jun 18, 2026
70.42Average Score
30
Jun 11, 2026
54.25pass@1
30
May 18, 2026
21.2Accuracy
30
May 29, 2026
86.86Pass@1
30
May 11, 2026
88.57Pass@1
30
May 11, 2026
84.76Pass@1
30
May 11, 2026
93.9Pass@1
30
May 11, 2026
59.8MBPP Accuracy
30
Apr 23, 2026
80.2Score
30
Jun 26, 2026
73.1Score
29
Jun 18, 2026
85.5Accuracy
29
Jun 30, 2026
76.9Accuracy
29
Mar 23, 2026
96.3During-task Accuracy
29
Feb 26, 2026
16.47Functional Score M
29
Feb 26, 2026
66.2Accuracy @ t1
29
Feb 26, 2026
69.25Pass@1
29
Feb 26, 2026
94.2Pass@1
29
Mar 26, 2026
70.1HumanEval+ Pass@k
29
May 27, 2026
45Accuracy
29
May 15, 2026
43.6Pass@1
28
May 29, 2026
83.33Accuracy
28
Jun 16, 2026
56.4Accuracy
28
Feb 26, 2026