Codebase generation on Online Chat App (test)
88.4Feature CompletenessCode-L2MAC
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Code-L2MAC2023.10 | 88.4 | 0 | 774 | 25.8 | |
| AutoGPTBackbone=GPT-42023.10 | 59.4 | 0 | 374 | 18.8 | |
| Self-Refine2023.10 | 23.1 | 1.85 | 220 | 3.08 | |
| CodeT2023.10 | 14.2 | 0.211 | 111 | 1.42 | |
| GPT42023.10 | 11 | 0.346 | 127 | 1.2 | |
| Reflexion2023.10 | 10.5 | 0 | 91.6 | 3.32 |