Code Editing on Aider whole format
1.5Average TriesCodeLlama-7B-Instruct
Evaluation results
| Method | Links | |
|---|---|---|
| CodeLlama-7B-InstructSize=7B2026.01 | 1.5 | |
| CodeLlama-70B-InstructSize=70B2026.01 | 15 | |
| OpenCoder-8B-InstructSize=8B2026.01 | 30.8 | |
| Llama-3.1-8B-InstructSize=8B2026.01 | 33.1 | |
| StarCoder2-15B-InstructSize=15B2026.01 | 38.2 | |
| CodeQwen1.5-7B-ChatSize=7B2026.01 | 38.3 | |
| DeepSeek-Coder-6.7B-InstructSize=6.7B2026.01 | 44.4 | |
| Seed-Diffusion-Preview(0705)Size=-2026.01 | 44.4 | |
| Codestral-22BSize=22B2026.01 | 51.1 | |
| DeepSeek-Coder-V2-Lite-InstructSize=2.4B/16B2026.01 | 52.6 | |
| Yi-Coder-9B-ChatSize=9B2026.01 | 54.1 | |
| DeepSeek-Coder-33B-InstructSize=33B2026.01 | 54.5 | |
| Stable-DiffCoder-8B-InstructSize=8B2026.01 | 54.9 | |
| Qwen3-8BSize=8B2026.01 | 55.6 | |
| Seed-Coder-8B-InstructSize=8B2026.01 | 57.1 | |
| Qwen2.5-Coder-7B-InstructSize=7B2026.01 | 57.9 | |
| Qwen2.5-Coder-14B-InstructSize=14B2026.01 | 69.2 |