ResearchBenchmarksRepo-level Method Body Completion on Repo-Eval Python (test)Follow56.09BLEURAMBO35.009240.482145.95551.4279Sep 23, 2024Evaluation ResultsMethodMethodLinksBLEUCodeBLEUPass@1EMRAMBOOracle=trueOracle=true2024.0956.0952.5846.3320.11RAMBO2024.0955.7852.3946.9220.11RLCoder2024.0952.7950.3843.718.23RepoCoderOracle=trueOracle=true2024.0952.7148.9140.4715.28RepoCoder2024.0951.0848.140.1816.89RawRAG2024.0948.2144.7336.6614.21Infile2024.0935.8234.2224.635.9