List your company

ResearchFormerly WizWand

Code Infilling

Benchmarks

DatasetSOTA methodMetricTrendResultsLast updated

HumanEval Infilling

57.12Pass@1 Mean

19

Jun 12, 2026

HumanEval single-line infilling (test)

code-davinci-002

87.4Pass Rate

12

Feb 26, 2026

HumanEval multi-line code infilling

38.6Pass Rate

12

Feb 26, 2026

Qwen2.5-Coder-7B

79.8EM

10

Feb 26, 2026

McEval Multi-line

40JavaScript Pass@1

10

Feb 26, 2026

McEval Single-line

78.8JavaScript Pass@1

10

Feb 26, 2026

HumanEval single-line

Qwen2.5-Coder-7B

92.6Pass@1

10

Feb 26, 2026

HumanEval random span

code-davinci-002

74.2pass@1 (PSM)

6

Feb 26, 2026