Reading Comprehension on Race M (Score)
45.47Race M ScoreRWKV-7B
Evaluation Results
| Method | Links | |
|---|---|---|
| RWKV-7BBackbone=RWKV-7B, Pruning ratio=0%2024.03 | 45.47 | |
| ReplaceMe (LS)Train-Free=true, Base Model=Llama 2 7B, Compression Ratio=25%2025.05 | 37.1 | |
| ReplaceMe (Cosine)Train-Free=true, Base Model=Llama 2 7B, Compression Ratio=25%2025.05 | 35.4 | |
| UIDLTrain-Free=false, Base Model=Llama 2 7B, Compression Ratio=25%2025.05 | 35.2 | |
| LLM-StreamlineTrain-Free=false, Base Model=Llama 2 7B, Compression Ratio=25%2025.05 | 34.8 | |
| Llama 2 7B (baseline)Base Model=Llama 2 7B, Compression Ratio=0%2025.05 | 33.1 | |
| SliceGPTTrain-Free=false, Base Model=Llama 2 7B, Compression Ratio=25%2025.05 | 27 | |
| ShortGPTBackbone=RWKV-7B, Pruning ratio=9.4%2024.03 | 25.77 | |
| Mamba-2.8BBackbone=Mamba-2.8B, Pruning ratio=0%2024.03 | 25.3 | |
| ShortGPTBackbone=Mamba-2.8B, Pruning ratio=10.9%2024.03 | 25.21 | |
| ShortGPTBackbone=RWKV-7B, Pruning ratio=18.8%2024.03 | 23.75 | |
| ShortGPTBackbone=Mamba-2.8B, Pruning ratio=20.3%2024.03 | 23.61 | |
| LaCoTrain-Free=false, Base Model=Llama 2 7B, Compression Ratio=25%2025.05 | 23.6 | |
| ShortGPTBackbone=Mamba-2.8B, Pruning ratio=25%2024.03 | 23.26 | |
| LLMPrunerTrain-Free=false, Base Model=Llama 2 7B, Compression Ratio=25%2025.05 | 22.9 | |
| ShortGPTBackbone=Mamba-2.8B, Pruning ratio=31.3%2024.03 | 22.77 | |
| ShortGPTBackbone=RWKV-7B, Pruning ratio=25%2024.03 | 21.59 | |
| ShortGPTBackbone=RWKV-7B, Pruning ratio=28.1%2024.03 | 21.31 |