List your company
ResearchFormerly WizWand

Code Generation on LiveCodeBench May 2023 to February 2024 (start date 2023-07-01)

24.1Pass@1CodeQwen1.5-7B-Chat
10.68414.16717.6521.133Oct 31, 2024
Updated 8mo ago

Evaluation results

MethodLinks
CodeQwen1.5-7B-ChatParameters=7B, Variant=Chat2024.1024.1
SelfCodeAlign-CQ-7BParameters=7B, Variant=CQ2024.1022.8
CodeQwen1.5-7B-OctoPackParameters=7B, Training Technique=OctoPack2024.1021.8
DeepSeek-Coder-6.7B-InstructParameters=6.7B, Variant=Instruct2024.1020.8
CodeQwen1.5-7B-BaseParameters=7B, Variant=Base2024.1020.7
Llama-3-8B-InstructParameters=8B, Variant=Instruct2024.1018.4
StarCoder2-15BParameters=15B2024.1014.7
CodeGemma-7B-ITParameters=7B, Variant=IT2024.1014.1
OctoCoder-16BParameters=16B2024.1011.2