Code Generation on MBPP Python
69.8Pass@1INTERVENOR
Evaluation results
| Method | Links | |
|---|---|---|
| INTERVENOR2023.11 | 69.8 | |
| Self-Collaboration2023.11 | 68.2 | |
| CodeLLama2023.11 | 61.2 | |
| WizardCoder2023.11 | 51.8 | |
| StarCoder2023.11 | 49.5 | |
| PaLM-Coder2023.11 | 47 | |
| LLama22023.11 | 45.4 | |
| GPT-3.52023.11 | 39.8 | |
| CodeGeeX2023.11 | 24.4 | |
| CodeGen2023.11 | 20.9 | |
| InCoder2023.11 | 19.4 |