ResearchBenchmarksCode Generation on MBPP Rust MultiPL-E translation (test)Code Generation on MBPP Rust MultiPL-E translation (test)Follow75.4Pass@1Reflexion70.7271.93573.1574.365Mar 20, 2023Evaluation resultsMethodMethodLinksPass@1ReflexionModel=GPT-4, Strategy=...Model=GPT-4, Strategy=Reflexion, Zero-shot=true2023.0375.4GPT-4Model=GPT-4, Strategy=...Model=GPT-4, Strategy=Zero-shot, Zero-shot=true2023.0370.9