Language Evaluation on WSC
86.51ScoreDense
Evaluation results
| Method | Links | |
|---|---|---|
| DenseLLM=Baichuan2-13B, Ratio=0.00%2024.03 | 86.51 | |
| LLMPrun.LLM=Baichuan2-7B, Ratio=24.2%2024.03 | 53.85 | |
| LaCoLLM=Llama2-13B, Ratio=24.6%2024.03 | 52.88 | |
| ShortGPTLLM=Llama2-7B, Ratio=27.1%2024.03 | 52.46 | |
| ShortGPTBackbone=RWKV-7B, Pruning ratio=28.1%2024.03 | 50.1 | |
| DenseLLM=Llama2-7B, Ratio=0.00%2024.03 | 50 | |
| DenseLLM=Llama2-13B, Ratio=0.00%2024.03 | 50 | |
| ShortGPTLLM=Llama2-13B, Ratio=24.6%2024.03 | 50 | |
| DenseLLM=Baichuan2-7B, Ratio=0.00%2024.03 | 50 | |
| ShortGPTLLM=Baichuan2-7B, Ratio=24.2%2024.03 | 50 | |
| RWKV-7BBackbone=RWKV-7B, Pruning ratio=0%2024.03 | 50 | |
| ShortGPTBackbone=RWKV-7B, Pruning ratio=9.4%2024.03 | 50 | |
| ShortGPTBackbone=RWKV-7B, Pruning ratio=18.8%2024.03 | 50 | |
| ShortGPTBackbone=RWKV-7B, Pruning ratio=25%2024.03 | 50 | |
| Mamba-2.8BBackbone=Mamba-2.8B, Pruning ratio=0%2024.03 | 49.69 | |
| ShortGPTBackbone=Mamba-2.8B, Pruning ratio=31.3%2024.03 | 49.69 | |
| ShortGPTBackbone=Mamba-2.8B, Pruning ratio=10.9%2024.03 | 49.28 | |
| ShortGPTBackbone=Mamba-2.8B, Pruning ratio=20.3%2024.03 | 48.36 | |
| ShortGPTBackbone=Mamba-2.8B, Pruning ratio=25%2024.03 | 48.26 | |
| ShortGPTLLM=Baichuan2-13B, Ratio=24.7%2024.03 | 47.13 | |
| LaCoLLM=Baichuan2-13B, Ratio=24.7%2024.03 | 44.23 | |
| LaCoLLM=Baichuan2-7B, Ratio=24.2%2024.03 | 42.31 | |
| LaCoLLM=Llama2-7B, Ratio=27.1%2024.03 | 40.38 | |
| LLMPrun.LLM=Llama2-13B, Ratio=24.4%2024.03 | 40.38 | |
| LLMPrun.LLM=Baichuan2-13B, Ratio=24.3%2024.03 | 37.5 | |
| LLMPrun.LLM=Llama2-7B, Ratio=27.0%2024.03 | 36.54 | |
| SliceGPTLLM=Llama2-7B, Ratio=26.4%2024.03 | 36.54 | |
| SliceGPTLLM=Llama2-13B, Ratio=23.6%2024.03 | 36.54 | |
| SliceGPTLLM=Baichuan2-7B, Ratio=22.2%2024.03 | 36.54 | |
| SliceGPTLLM=Baichuan2-13B, Ratio=22.8%2024.03 | 36.54 |