Code Generation on CODEAGENTBENCH NumpyML easy
17Solved ProblemsCODEAGENT
Evaluation results
| Method | Links | |
|---|---|---|
| CODEAGENTBackbone=GPT-4, Product Category=Our Agent2024.01 | 17 | |
| CODEAGENTBackbone=GPT-3.5, Product Category=Our Agent2024.01 | 14 | |
| GitHub CopilotProduct Category=IDE Product2024.01 | 7 | |
| Amazon CodeWhispererProduct Category=IDE Product2024.01 | 5 | |
| AutoGPTBackbone=GPT-4, Product Category=Agent Product2024.01 | 2 |