List your company

ResearchFormerly WizWand

SAFIM

Benchmarks

TaskDatasetSOTA resultTrendResults

Fill-in-the-Middle Code Completion

SAFIM control

41Exact Match (EM)

16

Fill-in-the-Middle Code Completion

SAFIM block v2

37.6Exact Match (EM)

16

Fill-in-the-Middle Code Completion

SAFIM block

30.9Exact Match (EM)

16

Fill-in-the-Middle Code Completion

SAFIM API

72.6Exact Match (%)

16

Block Infilling

SAFIM

69.47Pass@1

6

Code Completion

SAFIM

54.1Pass@1

3

Reasoning failure prediction and recovery

SAFIM L3

81Accuracy

2

Reasoning failure prediction and recovery

SAFIM L1

79Accuracy

2