Code Symbol Understanding on Code Symbol Understanding 1.0 (test)
14.15RecallHiROPE
Evaluation results
| Method | Links | |
|---|---|---|
| HiROPEBackbone=TinyLLaMA 1.1B2024.03 | 14.15 | |
| ReROPEBackbone=TinyLLaMA 1.1B2024.03 | 12.14 | |
| HiROPEBackbone=LLaMA-2 7B2024.03 | 9.11 | |
| ReROPEBackbone=LLaMA-2 7B2024.03 | 8.37 | |
| HiROPEBackbone=ShearedLLaMA 1.3B2024.03 | 8.09 | |
| ReROPEBackbone=ShearedLLaMA 1.3B2024.03 | 7.43 | |
| HiROPEBackbone=Vicuna 7B2024.03 | 7.21 | |
| ReROPEBackbone=Vicuna 7B2024.03 | 6.36 | |
| originBackbone=ShearedLLaMA 1.3B2024.03 | 0.67 | |
| originBackbone=TinyLLaMA 1.1B2024.03 | 0.67 | |
| originBackbone=Vicuna 7B2024.03 | 0.67 | |
| originBackbone=LLaMA-2 7B2024.03 | 0.12 |