Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Code Infilling research benchmarks · SOTA2 Research

Code Infilling

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

HumanEval Infilling

57.12Pass@1 Mean

19

Jun 12, 2026

HumanEval single-line infilling (test)

code-davinci-002

87.4Pass Rate

12

Feb 26, 2026

HumanEval multi-line code infilling

38.6Pass Rate

12

Feb 26, 2026

Qwen2.5-Coder-7B

79.8EM

10

Feb 26, 2026

McEval Multi-line

40JavaScript Pass@1

10

Feb 26, 2026

McEval Single-line

78.8JavaScript Pass@1

10

Feb 26, 2026

HumanEval single-line

Qwen2.5-Coder-7B

92.6Pass@1

10

Feb 26, 2026

HumanEval random span

code-davinci-002

74.2pass@1 (PSM)

6

Feb 26, 2026

Popular datasets

HumanEval MCEval SantaCoder

Follow for updates

Join SOTA2 Contact