Code generation on LiveCodeBench start date 2023-09-01 May 2023 to February 2024
23.2Pass@1CodeQwen1.5-7B-Chat
Evaluation results
| Method | Links | |
|---|---|---|
| CodeQwen1.5-7B-ChatParameters=7B, Variant=Chat2024.10 | 23.2 | |
| SelfCodeAlign-CQ-7BParameters=7B, Variant=CQ2024.10 | 22.4 | |
| CodeQwen1.5-7B-BaseParameters=7B, Variant=Base2024.10 | 19.3 | |
| CodeQwen1.5-7B-OctoPackParameters=7B, Training Technique=OctoPack2024.10 | 19.3 | |
| DeepSeek-Coder-6.7B-InstructParameters=6.7B, Variant=Instruct2024.10 | 19.2 | |
| Llama-3-8B-InstructParameters=8B, Variant=Instruct2024.10 | 18.3 | |
| CodeGemma-7B-ITParameters=7B, Variant=IT2024.10 | 15.2 | |
| StarCoder2-15BParameters=15B2024.10 | 14.5 | |
| OctoCoder-16BParameters=16B2024.10 | 12.6 |