Repository-level code-completion on RepoEval (test)
49.9Exact MatchRLCoder
Evaluation results
| Method | Links | |
|---|---|---|
| RLCoderParams=1.1B, Latency=8.8s, Offline=50.4s2026.02 | 49.9 | |
| GraphCoderParams=16B, Latency=17.5s, Offline=10.2s2026.02 | 48.7 | |
| DRACOParams=7.1B, Latency=11.0s, Offline=14.3s2026.02 | 46.4 | |
| HEF (e2e + p-tuning)Params=1.8B, Latency=0.59s, Offline=1806s2026.02 | 43.9 | |
| HEF (end-to-end)Params=1.8B, Latency=0.68s, Offline=35.1s2026.02 | 42.7 | |
| HEF (separate)Params=1.8B, Latency=0.94s, Offline=35.1s2026.02 | 34.1 | |
| RepoFusionParams=0.22B, Latency=0.9s, Offline=24.6s2026.02 | 33.2 | |
| Qwen-2.5-Coder-1.3BParams=1.5B, Latency=0.50s2026.02 | 28.4 |