General NLP Evaluation on Natural Language Benchmarks Aggregate
62.31Average ScoreDense
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| DenseLLM=Baichuan2-13B, Ratio=0.00%2024.03 | 62.31 | 100 | |
| DenseLLM=Baichuan2-7B, Ratio=0.00%2024.03 | 57.67 | 100 | |
| DenseLLM=Llama2-13B, Ratio=0.00%2024.03 | 55.14 | 100 | |
| ShortGPTLLM=Baichuan2-13B, Ratio=24.7%2024.03 | 54.43 | 87.35 | |
| LaCoLLM=Baichuan2-13B, Ratio=24.7%2024.03 | 53.43 | 85.75 | |
| ShortGPTLLM=Llama2-13B, Ratio=24.6%2024.03 | 50.53 | 91.64 | |
| RWKV-7BBackbone=RWKV-7B, Pruning ratio=0%2024.03 | 50.37 | 100 | |
| ShortGPTLLM=Baichuan2-7B, Ratio=24.2%2024.03 | 49.08 | 85.1 | |
| DenseLLM=Llama2-7B, Ratio=0.00%2024.03 | 47.78 | 100 | |
| LaCoLLM=Llama2-13B, Ratio=24.6%2024.03 | 47.62 | 86.36 | |
| ShortGPTBackbone=RWKV-7B, Pruning ratio=9.4%2024.03 | 43.94 | 87.23 | |
| LaCoLLM=Baichuan2-7B, Ratio=24.2%2024.03 | 42.93 | 74.44 | |
| LLMPrun.LLM=Baichuan2-7B, Ratio=24.2%2024.03 | 41.76 | 72.41 | |
| ShortGPTLLM=Llama2-7B, Ratio=27.1%2024.03 | 41.24 | 86.31 | |
| Mamba-2.8BBackbone=Mamba-2.8B, Pruning ratio=0%2024.03 | 41.12 | 100 | |
| ShortGPTBackbone=RWKV-7B, Pruning ratio=18.8%2024.03 | 40.38 | 80.17 | |
| LLMPrun.LLM=Baichuan2-13B, Ratio=24.3%2024.03 | 39.2 | 62.91 | |
| ShortGPTBackbone=Mamba-2.8B, Pruning ratio=10.9%2024.03 | 39.08 | 95.04 | |
| LLMPrun.LLM=Llama2-13B, Ratio=24.4%2024.03 | 38.97 | 70.67 | |
| LaCoLLM=Llama2-7B, Ratio=27.1%2024.03 | 38.41 | 80.39 | |
| ShortGPTBackbone=Mamba-2.8B, Pruning ratio=20.3%2024.03 | 38.36 | 93.29 | |
| ShortGPTBackbone=Mamba-2.8B, Pruning ratio=25%2024.03 | 37.18 | 90.42 | |
| ShortGPTBackbone=RWKV-7B, Pruning ratio=25%2024.03 | 36.85 | 73.16 | |
| ShortGPTBackbone=Mamba-2.8B, Pruning ratio=31.3%2024.03 | 35.59 | 86.55 | |
| SliceGPTLLM=Llama2-13B, Ratio=23.6%2024.03 | 34.85 | 63.2 | |
| LLMPrun.LLM=Llama2-7B, Ratio=27.0%2024.03 | 34.78 | 72.79 | |
| ShortGPTBackbone=RWKV-7B, Pruning ratio=28.1%2024.03 | 33.82 | 67.14 | |
| SliceGPTLLM=Llama2-7B, Ratio=26.4%2024.03 | 32.84 | 68.73 | |
| SliceGPTLLM=Baichuan2-7B, Ratio=22.2%2024.03 | 26.23 | 45.48 | |
| SliceGPTLLM=Baichuan2-13B, Ratio=22.8%2024.03 | 25.23 | 40.49 |