ResearchBenchmarksCode Completion on CrossCodeEval Project-level (test)Code Completion on CrossCodeEval Project-level (test)Follow9.08C-EMCoCoGen1.62323.55915.4957.4309Mar 25, 2024Evaluation resultsMethodMethodLinksC-EMC-ESI-EMI-F1CoCoGenBase Model=GPT-3.5-TurboBase Model=GPT-3.5-Turbo2024.039.0855.3114.1142.34RepoCoderBase Model=GPT-3.5-TurboBase Model=GPT-3.5-Turbo2024.038.5255.0513.0241.05ReAccBase Model=GPT-3.5-TurboBase Model=GPT-3.5-Turbo2024.035.4854.0310.0238.49DirectBase Model=GPT-3.5-TurboBase Model=GPT-3.5-Turbo2024.031.9150.513.632.27