Reasoning on CMNLI
34.43ScoreLaCo
Evaluation results
| Method | Links | |
|---|---|---|
| LaCoLLM=Llama2-7B, Ratio=27.1%2024.03 | 34.43 | |
| LLMPrun.LLM=Llama2-7B, Ratio=27.0%2024.03 | 34.33 | |
| LLMPrun.LLM=Baichuan2-13B, Ratio=24.3%2024.03 | 33.8 | |
| DenseLLM=Baichuan2-7B, Ratio=0.00%2024.03 | 33.37 | |
| ShortGPTLLM=Baichuan2-7B, Ratio=24.2%2024.03 | 33.3 | |
| DenseLLM=Baichuan2-13B, Ratio=0.00%2024.03 | 33.21 | |
| LLMPrun.LLM=Llama2-13B, Ratio=24.4%2024.03 | 33.03 | |
| LaCoLLM=Baichuan2-13B, Ratio=24.7%2024.03 | 33.03 | |
| ShortGPTLLM=Llama2-13B, Ratio=24.6%2024.03 | 33 | |
| LaCoLLM=Baichuan2-7B, Ratio=24.2%2024.03 | 33 | |
| DenseLLM=Llama2-7B, Ratio=0.00%2024.03 | 32.99 | |
| DenseLLM=Llama2-13B, Ratio=0.00%2024.03 | 32.99 | |
| ShortGPTLLM=Llama2-7B, Ratio=27.1%2024.03 | 32.95 | |
| LaCoLLM=Llama2-13B, Ratio=24.6%2024.03 | 32.86 | |
| ShortGPTLLM=Baichuan2-13B, Ratio=24.7%2024.03 | 32.81 | |
| LLMPrun.LLM=Baichuan2-7B, Ratio=24.2%2024.03 | 32.28 | |
| SliceGPTLLM=Baichuan2-7B, Ratio=22.2%2024.03 | 32.07 | |
| SliceGPTLLM=Baichuan2-13B, Ratio=22.8%2024.03 | 32.07 | |
| SliceGPTLLM=Llama2-7B, Ratio=26.4%2024.03 | 31.7 | |
| SliceGPTLLM=Llama2-13B, Ratio=23.6%2024.03 | 29.82 |