Code Generation on LeetCodeHard
38.2AccuracyReflexion
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| ReflexionCost setting=High2025.12 | 38.2 | 0.736 | |
| Reflexion + BeFSCost setting=High2025.12 | 38.1 | 0.512 | |
| Reflexion + best-of-NCost setting=High2025.12 | 37.6 | 0.508 | |
| Reflexion + BeFSCost setting=Low2025.12 | 36.1 | 0.168 | |
| Reflexion + BeFSCost setting=Medium2025.12 | 36.1 | 0.289 | |
| ReflexionCost setting=Medium2025.12 | 35.9 | 0.449 | |
| ReflexionCost setting=Low2025.12 | 35.5 | 0.279 | |
| Reflexion + best-of-NCost setting=Low2025.12 | 35.5 | 0.279 |