ResearchBenchmarksCode Generation on xCodeEval CCode Generation on xCodeEval CFollow24.5Pass@1CodeSim8.79612.87316.9521.027Feb 8, 2025Evaluation resultsMethodMethodLinksPass@1CodeSimBase LLM=ChatGPTBase LLM=ChatGPT2025.0224.5MapCoderBase LLM=ChatGPTBase LLM=ChatGPT2025.0221.7DirectBase LLM=ChatGPTBase LLM=ChatGPT2025.029.4