Examination on MMLU
55MMLU ScoreDense
Evaluation results
| Method | Links | |
|---|---|---|
| DenseLLM=Llama2-13B, Ratio=0.00%2024.03 | 55 | |
| ShortGPTLLM=Llama2-13B, Ratio=24.6%2024.03 | 54.69 | |
| DenseLLM=Baichuan2-7B, Ratio=0.00%2024.03 | 53.87 | |
| ShortGPTLLM=Baichuan2-13B, Ratio=24.7%2024.03 | 52.11 | |
| LaCoLLM=Baichuan2-13B, Ratio=24.7%2024.03 | 51.35 | |
| DenseLLM=Baichuan2-13B, Ratio=0.00%2024.03 | 47.87 | |
| LaCoLLM=Llama2-13B, Ratio=24.6%2024.03 | 45.93 | |
| ShortGPTLLM=Baichuan2-7B, Ratio=24.2%2024.03 | 45.77 | |
| DenseLLM=Llama2-7B, Ratio=0.00%2024.03 | 45.39 | |
| ShortGPTLLM=Llama2-7B, Ratio=27.1%2024.03 | 43.96 | |
| SliceGPTLLM=Llama2-13B, Ratio=23.6%2024.03 | 37.14 | |
| LaCoLLM=Baichuan2-7B, Ratio=24.2%2024.03 | 31.53 | |
| SliceGPTLLM=Llama2-7B, Ratio=26.4%2024.03 | 28.92 | |
| LaCoLLM=Llama2-7B, Ratio=27.1%2024.03 | 26.45 | |
| LLMPrun.LLM=Llama2-13B, Ratio=24.4%2024.03 | 25.21 | |
| SliceGPTLLM=Baichuan2-7B, Ratio=22.2%2024.03 | 25.18 | |
| LLMPrun.LLM=Baichuan2-7B, Ratio=24.2%2024.03 | 24.93 | |
| LLMPrun.LLM=Llama2-7B, Ratio=27.0%2024.03 | 23.33 | |
| LLMPrun.LLM=Baichuan2-13B, Ratio=24.3%2024.03 | 23.19 | |
| SliceGPTLLM=Baichuan2-13B, Ratio=22.8%2024.03 | 22.95 |