Code generation on LiveCodeBench May 2023 to February 2024 (start date 2023-05-01)
25Pass@1CodeQwen1.5-7B-Chat
Evaluation results
| Method | Links | |
|---|---|---|
| CodeQwen1.5-7B-ChatParameters=7B, Variant=Chat2024.10 | 25 | |
| SelfCodeAlign-CQ-7BParameters=7B, Variant=CQ2024.10 | 23.4 | |
| CodeQwen1.5-7B-OctoPackParameters=7B, Training Technique=OctoPack2024.10 | 22.5 | |
| CodeQwen1.5-7B-BaseParameters=7B, Variant=Base2024.10 | 21.8 | |
| DeepSeek-Coder-6.7B-InstructParameters=6.7B, Variant=Instruct2024.10 | 21.6 | |
| Llama-3-8B-InstructParameters=8B, Variant=Instruct2024.10 | 17.3 | |
| StarCoder2-15BParameters=15B2024.10 | 15.4 | |
| CodeGemma-7B-ITParameters=7B, Variant=IT2024.10 | 13.6 | |
| OctoCoder-16BParameters=16B2024.10 | 9.8 |