Repo-level Method Body Completion on RAMBO's benchmark (test) benchmark leaderboard · SOTA2 Research

Repo-level Method Body Completion on RAMBO's benchmark (test)

51.21BLEURAMBO Oracle

Evaluation Results

Method	Links
RAMBO Oracle2024.09		51.21	53.91	60.85	19.15
RAMBO Oracle2024.09		50.87	53.96	63.4	18.72
RAMBO2024.09		50.44	53.2	61.7	18.94
RepoCoder Oracle2024.09		50.04	52.48	58.51	17.02
RAMBO2024.09		49.58	52.71	58.94	19.15
RepoCoder Oracle2024.09		47.82	51.43	62.13	17.02
RawRAG2024.09		46.92	50.97	60.21	15.32
RepoCoder Oracle2024.09		46.59	49.53	55.96	14.68
RepoCoder2024.09		46.22	50.31	57.23	15.53
RLCoder2024.09		45.12	49.48	58.72	15.32
RLCoder2024.09		45.08	48.58	55.96	14.26
RepoCoder2024.09		44.41	49.64	58.09	15.74
RAMBO2024.09		43.16	47.76	55.96	13.62
RepoCoder2024.09		42.98	47.66	55.32	12.77
RawRAG2024.09		42.9	45.27	55.53	12.55
RAMBO Oracle2024.09		41.83	46.22	51.28	14.89
RawRAG2024.09		41.57	45.96	54.89	12.55
RLCoder2024.09		39.92	44.3	54.47	10.85
In-File2024.09		33.93	39.25	53.11	6.38
In-File2024.09		25.99	33.84	45.11	4.04
In-File2024.09		25.09	33.85	48.09	3.83