Fill-in-the-Middle Code Completion
Benchmarks
DatasetSOTA methodMetricTrendResultsLast updated
4.4Exact Match (EM)
16
Jun 4, 2026
41Exact Match (EM)
16
Jun 4, 2026
37.6Exact Match (EM)
16
Jun 4, 2026
30.9Exact Match (EM)
16
Jun 4, 2026
72.6Exact Match (%)
16
Jun 4, 2026
50.4Exact Match (EM)
16
Jun 4, 2026
27.1Exact Match (EM)
16
Jun 4, 2026
57.3Exact Match (EM)
16
Jun 4, 2026
62.4EM (%)
16
Jun 4, 2026
68.3Python Score
7
Feb 26, 2026