Code Editing on CanItEdit
60Pass@1Stable-DiffCoder-8B-Instruct
Evaluation results
| Method | Links | |
|---|---|---|
| Stable-DiffCoder-8B-InstructSize=8B2026.01 | 60 | |
| Seed-Diffusion-Preview(0705)Size=-2026.01 | 54.3 | |
| Qwen2.5-Coder-14B-InstructSize=14B2026.01 | 52.9 | |
| Codestral-22BSize=22B2026.01 | 52.4 | |
| Yi-Coder-9B-ChatSize=9B2026.01 | 50.5 | |
| Seed-Coder-8B-InstructSize=8B2026.01 | 50.5 | |
| Qwen2.5-Coder-7B-InstructSize=7B2026.01 | 49.5 | |
| DeepSeek-Coder-33B-InstructSize=33B2026.01 | 46.2 | |
| Qwen3-8BSize=8B2026.01 | 45.7 | |
| DeepSeek-Coder-V2-Lite-InstructSize=2.4B/16B2026.01 | 45.2 | |
| CodeLlama-70B-InstructSize=70B2026.01 | 40.5 | |
| Llama-3.1-8B-InstructSize=8B2026.01 | 39.5 | |
| OpenCoder-8B-InstructSize=8B2026.01 | 39 | |
| DeepSeek-Coder-6.7B-InstructSize=6.7B2026.01 | 36.9 | |
| CodeQwen1.5-7B-ChatSize=7B2026.01 | 34.8 | |
| StarCoder2-15B-InstructSize=15B2026.01 | 31.4 | |
| CodeLlama-7B-InstructSize=7B2026.01 | 25.7 |