Codebase generation on Recipe App
82Feature CompletionCode-L2MAC
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Code-L2MAC2023.10 | 82 | 0 | 497 | 24.6 | 94.2 | |
| AutoGPT2023.10 | 39.2 | 1.85 | 106 | 1.3 | 9.8 | |
| Self-Refine2023.10 | 26 | 0.1 | 149 | 2 | 76.2 | |
| GPT42023.10 | 21.6 | 3.15 | 97.5 | 9.2 | 10.7 | |
| CodeT2023.10 | 20.5 | 0 | 96.5 | 3.05 | 97.8 | |
| Reflexion2023.10 | 19 | 0.25 | 95.9 | 2.95 | 89.9 |