Block Infilling on SAFIM
69.47Pass@1DeepSeek-R1
Evaluation results
| Method | Links | |
|---|---|---|
| DeepSeek-R1Composition Level=L12026.04 | 69.47 | |
| QwQ-32BComposition Level=L12026.04 | 48.9 | |
| DeepSeek-R1Composition Level=L22026.04 | 17.38 | |
| DeepSeek-R1Composition Level=L32026.04 | 16.24 | |
| QwQ-32BComposition Level=L22026.04 | 12.92 | |
| QwQ-32BComposition Level=L32026.04 | 9.35 |