Examination on CMMLU
61.3ScoreDense
Evaluation results
| Method | Links | |
|---|---|---|
| DenseLLM=Baichuan2-13B, Ratio=0.00%2024.03 | 61.3 | |
| ShortGPTLLM=Baichuan2-13B, Ratio=24.7%2024.03 | 58.86 | |
| DenseLLM=Baichuan2-7B, Ratio=0.00%2024.03 | 56.95 | |
| LaCoLLM=Baichuan2-13B, Ratio=24.7%2024.03 | 53.65 | |
| ShortGPTLLM=Baichuan2-7B, Ratio=24.2%2024.03 | 47.87 | |
| DenseLLM=Llama2-13B, Ratio=0.00%2024.03 | 38.4 | |
| ShortGPTLLM=Llama2-13B, Ratio=24.6%2024.03 | 38.38 | |
| DenseLLM=Llama2-7B, Ratio=0.00%2024.03 | 32.92 | |
| LaCoLLM=Llama2-13B, Ratio=24.6%2024.03 | 32.62 | |
| ShortGPTLLM=Llama2-7B, Ratio=27.1%2024.03 | 32.25 | |
| LaCoLLM=Baichuan2-7B, Ratio=24.2%2024.03 | 31.24 | |
| SliceGPTLLM=Llama2-13B, Ratio=23.6%2024.03 | 25.79 | |
| LLMPrun.LLM=Baichuan2-7B, Ratio=24.2%2024.03 | 25.69 | |
| SliceGPTLLM=Llama2-7B, Ratio=26.4%2024.03 | 25.37 | |
| SliceGPTLLM=Baichuan2-13B, Ratio=22.8%2024.03 | 25.26 | |
| LLMPrun.LLM=Llama2-7B, Ratio=27.0%2024.03 | 25.25 | |
| SliceGPTLLM=Baichuan2-7B, Ratio=22.2%2024.03 | 25.25 | |
| LaCoLLM=Llama2-7B, Ratio=27.1%2024.03 | 25.24 | |
| LLMPrun.LLM=Baichuan2-13B, Ratio=24.3%2024.03 | 25.18 | |
| LLMPrun.LLM=Llama2-13B, Ratio=24.4%2024.03 | 24.71 |