Code Generation on BigCodeBench instruct
0.41Full ScoreQwen2.5-Coder-7B-Instruct
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Qwen2.5-Coder-7B-InstructSize=7B2024.11 | 0.41 | 0.182 | |
| OpenCoder-8B-InstructSize=8B2024.11 | 0.403 | 0.169 | |
| CodeQwen1.5-7B-ChatSize=7B2024.11 | 0.396 | 0.189 | |
| Yi-Coder-9B-ChatSize=9B2024.11 | 0.381 | 0.115 | |
| StarCoder2-15B-Instruct-v0.1Size=15B2024.11 | 0.376 | 0.122 | |
| DS-Coder-V2-Lite-InstructSize=16B2024.11 | 0.368 | 0.162 | |
| DS-Coder-6.7B-InstructSize=6.7B2024.11 | 0.355 | 0.101 | |
| OpenCoder-1.5B-InstructSize=1.5B2024.11 | 0.333 | 0.115 | |
| Qwen2.5-Coder-1.5B-InstructSize=1.5B2024.11 | 0.325 | 0.068 | |
| CodeGemma-7B-ItSize=7B2024.11 | 0.323 | 0.074 | |
| CrystalChat-7BSize=7B2024.11 | 0.267 | 0.023 | |
| Yi-Coder-1.5B-ChatSize=1.5B2024.11 | 0.24 | 0.068 | |
| DS-coder-1.3B-InstructSize=1.3B2024.11 | 0.228 | 0.034 | |
| CodeLlama-7B-InstructSize=7B2024.11 | 0.219 | 0.034 |