ResearchBenchmarksCode Generation on Leetcode Hard Python released after Oct 8, 2022 (test)Code Generation on Leetcode Hard Python released after Oct 8, 2022 (test)Follow15Pass@1Reflexion7.29.22511.2513.275Mar 20, 2023Evaluation resultsMethodMethodLinksPass@1ReflexionModel=GPT-4, Strategy=...Model=GPT-4, Strategy=Reflexion, Zero-shot=true2023.0315GPT-4Model=GPT-4, Strategy=...Model=GPT-4, Strategy=Zero-shot, Zero-shot=true2023.037.5