Code Generation on MBPP n=500
86.2pass@1GPT-4o
Evaluation results
| Method | Links | |
|---|---|---|
| GPT-4oRepair strategy=+VER2026.04 | 86.2 | |
| GPT-4oRepair strategy=1-pass2026.04 | 83.4 | |
| AeroTherm-GPTRepair strategy=+VER2026.04 | 75 | |
| Llama-3-70BRepair strategy=+VER2026.04 | 73.8 | |
| Llama-3-70BRepair strategy=1-pass2026.04 | 69.6 | |
| AeroTherm-GPTRepair strategy=1-pass2026.04 | 68.2 |