Long Code Completion on RepoBench >8k
51.24Edit SimHiROPE
Evaluation results
| Method | Links | |
|---|---|---|
| HiROPEBackbone=LLaMA-2 7B2024.03 | 51.24 | |
| HiROPEBackbone=Vicuna 7B2024.03 | 45.93 | |
| ReROPEBackbone=LLaMA-2 7B2024.03 | 45.38 | |
| ReROPEBackbone=Vicuna 7B2024.03 | 45.23 | |
| HiROPEBackbone=TinyLLaMA 1.1B2024.03 | 39.82 | |
| HiROPEBackbone=ShearedLLaMA 1.3B2024.03 | 39.52 | |
| ReROPEBackbone=TinyLLaMA 1.1B2024.03 | 39.38 | |
| ReROPEBackbone=ShearedLLaMA 1.3B2024.03 | 33.44 | |
| originBackbone=TinyLLaMA 1.1B2024.03 | 7.07 | |
| originBackbone=LLaMA-2 7B2024.03 | 6.59 | |
| originBackbone=ShearedLLaMA 1.3B2024.03 | 2.35 | |
| originBackbone=Vicuna 7B2024.03 | 2.32 |