Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

SAFIM dataset and benchmarks · SOTA2 Research

Research Datasets

SAFIM

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Fill-in-the-Middle Code Completion

SAFIM control

41Exact Match (EM)

16

Fill-in-the-Middle Code Completion

SAFIM block v2

37.6Exact Match (EM)

16

Fill-in-the-Middle Code Completion

SAFIM block

30.9Exact Match (EM)

16

Fill-in-the-Middle Code Completion

SAFIM API

72.6Exact Match (%)

16

Block Infilling

SAFIM

69.47Pass@1

6

Code Completion

SAFIM

54.1Pass@1

3

Reasoning failure prediction and recovery

SAFIM L3

81Accuracy

2

Reasoning failure prediction and recovery

SAFIM L1

79Accuracy

2

Popular tasks

Fill-in-the-Middle Code Completion Reasoning failure prediction and recovery Code Completion Block Infilling

Follow for updates

Join SOTA2 Contact