Code Generation on LiveCodeBench pass@1 v5
30.7pass@1Qwen2.5-Coder-32B-Instruct
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen2.5-Coder-32B-InstructSize=32B2026.01 | 30.7 | |
| DeepSeek-Coder-V2-InstructSize=21B/236B2026.01 | 28.9 | |
| Seed-Coder-8B-InstructSize=8B2026.01 | 24.7 | |
| Qwen3-8BSize=8B2026.01 | 23.5 | |
| Stable-DiffCoder-8B-InstructSize=8B2026.01 | 23.5 | |
| Codestral-22BSize=22B2026.01 | 20.5 | |
| Qwen2.5-Coder-14B-InstructSize=14B2026.01 | 19.3 | |
| Yi-Coder-9B-ChatSize=9B2026.01 | 17.5 | |
| Qwen2.5-Coder-7B-InstructSize=7B2026.01 | 17.3 | |
| OpenCoder-8B-InstructSize=8B2026.01 | 17.1 | |
| CodeLlama-70B-InstructSize=70B2026.01 | 14.5 | |
| DeepSeek-Coder-33B-InstructSize=33B2026.01 | 14.5 | |
| DeepSeek-Coder-V2-Lite-InstructSize=2.4B/16B2026.01 | 14.2 | |
| Llama-3.1-8B-InstructSize=8B2026.01 | 11.5 | |
| DeepSeek-Coder-6.7B-InstructSize=6.7B2026.01 | 9.6 | |
| StarCoder2-15B-InstructSize=15B2026.01 | 5.3 | |
| CodeLlama-7B-InstructSize=7B2026.01 | 3.6 | |
| CodeQwen1.5-7B-ChatSize=7B2026.01 | 3 |