ResearchBenchmarksCode Generation on xCodeEval PythonCode Generation on xCodeEval PythonFollow27.4Pass@1MapCoder17.5220.08522.6525.215Feb 8, 2025Evaluation resultsMethodMethodLinksPass@1MapCoderBase LLM=ChatGPTBase LLM=ChatGPT2025.0227.4CodeSimBase LLM=ChatGPTBase LLM=ChatGPT2025.0227.4DirectBase LLM=ChatGPTBase LLM=ChatGPT2025.0217.9