List your company
ResearchFormerly WizWand

Code Generation on DS-1000 Python

39.7Pass@1INTERVENOR
6.10814.82923.5532.271Nov 16, 2023
Updated 8mo ago

Evaluation results

MethodLinks
INTERVENOR2023.1139.7
GPT-3.52023.1129.7
WizardCoder2023.1128.4
CodeLLama2023.1128
StarCoder2023.1126
CodeGen2023.118.4
InCoder2023.117.4