Code Generation on MBPP MBPP+
83.5MBPP ScoreQwen2.5-Coder-7B-Instruct
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Qwen2.5-Coder-7B-InstructSize=7B2024.11 | 83.5 | 71.7 | |
| CodeQwen1.5-7B-ChatSize=7B2024.11 | 83.3 | 71.4 | |
| DS-Coder-V2-Lite-InstructSize=16B2024.11 | 82.3 | 68.8 | |
| Yi-Coder-9B-ChatSize=9B2024.11 | 81.5 | 69.3 | |
| OpenCoder-8B-InstructSize=8B2024.11 | 79.1 | 69 | |
| StarCoder2-15B-Instruct-v0.1Size=15B2024.11 | 75.2 | 61.2 | |
| DS-Coder-6.7B-InstructSize=6.7B2024.11 | 75.1 | 66.1 | |
| OpenCoder-1.5B-InstructSize=1.5B2024.11 | 72.7 | 61.9 | |
| CodeGemma-7B-ItSize=7B2024.11 | 69.8 | 59 | |
| Qwen2.5-Coder-1.5B-InstructSize=1.5B2024.11 | 69.2 | 59.4 | |
| Yi-Coder-1.5B-ChatSize=1.5B2024.11 | 68 | 59 | |
| DS-coder-1.3B-InstructSize=1.3B2024.11 | 61.6 | 52.6 | |
| CodeLlama-7B-InstructSize=7B2024.11 | 39.9 | 33.6 | |
| CrystalChat-7BSize=7B2024.11 | 39.1 | 32.7 |