Code Generation on CODEAGENTBENCH NumpyML hard
5Solved ProblemsCODEAGENT
Evaluation results
| Method | Links | |
|---|---|---|
| CODEAGENTBackbone=GPT-4, Product Category=Our Agent2024.01 | 5 | |
| CODEAGENTBackbone=GPT-3.5, Product Category=Our Agent2024.01 | 3 | |
| GitHub CopilotProduct Category=IDE Product2024.01 | 1 | |
| Amazon CodeWhispererProduct Category=IDE Product2024.01 | 0 | |
| AutoGPTBackbone=GPT-4, Product Category=Agent Product2024.01 | 0 |