Code Generation on HumanEval (Model Performance Scores)
87.8HumanEval Score (ID 4)ANN
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ANN2025.06 | 87.8 | 72.7 | 90.9 | |
| Symbolic2025.06 | 85.8 | 64.5 | — | |
| Agents2025.06 | 85 | 59.5 | — | |
| Agents w/ AutoPE2025.06 | 82.3 | 63.5 | — | |
| DSPy / ToT2025.06 | 77.3 | 66.7 | — | |
| GPTs2025.06 | 71.7 | 59.2 | — |