Long Code Completion on LCC (4k-8k)
69.93Edit SimilarityHiROPE
Evaluation results
| Method | Links | |
|---|---|---|
| HiROPEBackbone=LLaMA-2 7B2024.03 | 69.93 | |
| ReROPEBackbone=LLaMA-2 7B2024.03 | 67.43 | |
| HiROPEBackbone=Vicuna 7B2024.03 | 62.01 | |
| ReROPEBackbone=Vicuna 7B2024.03 | 59.73 | |
| ReROPEBackbone=TinyLLaMA 1.1B2024.03 | 57.2 | |
| HiROPEBackbone=ShearedLLaMA 1.3B2024.03 | 51.67 | |
| HiROPEBackbone=TinyLLaMA 1.1B2024.03 | 42.83 | |
| ReROPEBackbone=ShearedLLaMA 1.3B2024.03 | 36.1 | |
| originBackbone=TinyLLaMA 1.1B2024.03 | 5.45 | |
| originBackbone=LLaMA-2 7B2024.03 | 4.36 | |
| originBackbone=ShearedLLaMA 1.3B2024.03 | 3.33 | |
| originBackbone=Vicuna 7B2024.03 | 2.56 |