Long Code Completion on LCC 0-4k
66.61Edit SimilarityHiROPE
Evaluation results
| Method | Links | |
|---|---|---|
| HiROPEBackbone=LLaMA-2 7B2024.03 | 66.61 | |
| ReROPEBackbone=LLaMA-2 7B2024.03 | 65.83 | |
| HiROPEBackbone=Vicuna 7B2024.03 | 63.42 | |
| ReROPEBackbone=Vicuna 7B2024.03 | 57.95 | |
| originBackbone=LLaMA-2 7B2024.03 | 54.5 | |
| ReROPEBackbone=TinyLLaMA 1.1B2024.03 | 49.22 | |
| HiROPEBackbone=ShearedLLaMA 1.3B2024.03 | 46.13 | |
| ReROPEBackbone=ShearedLLaMA 1.3B2024.03 | 35.56 | |
| HiROPEBackbone=TinyLLaMA 1.1B2024.03 | 35.17 | |
| originBackbone=ShearedLLaMA 1.3B2024.03 | 27.17 | |
| originBackbone=Vicuna 7B2024.03 | 18.47 | |
| originBackbone=TinyLLaMA 1.1B2024.03 | 17.29 |