Long Code Completion on LCC >8k
65.38Edit SimHiROPE
Evaluation results
| Method | Links | |
|---|---|---|
| HiROPEBackbone=LLaMA-2 7B2024.03 | 65.38 | |
| HiROPEBackbone=Vicuna 7B2024.03 | 64.42 | |
| ReROPEBackbone=LLaMA-2 7B2024.03 | 63.22 | |
| ReROPEBackbone=Vicuna 7B2024.03 | 58.52 | |
| ReROPEBackbone=TinyLLaMA 1.1B2024.03 | 53.11 | |
| HiROPEBackbone=TinyLLaMA 1.1B2024.03 | 49.92 | |
| HiROPEBackbone=ShearedLLaMA 1.3B2024.03 | 46.33 | |
| ReROPEBackbone=ShearedLLaMA 1.3B2024.03 | 36.91 | |
| originBackbone=TinyLLaMA 1.1B2024.03 | 6.28 | |
| originBackbone=LLaMA-2 7B2024.03 | 4.08 | |
| originBackbone=Vicuna 7B2024.03 | 2.76 | |
| originBackbone=ShearedLLaMA 1.3B2024.03 | 2.52 |