Natural Language Inference on CMNLI
79.07ScoreQwen2.5
Evaluation Results
| Method | Links | |
|---|---|---|
| Qwen2.52025.12 | 79.07 | |
| Qwen32025.12 | 71.43 | |
| Gamayun2025.12 | 68.9 | |
| Llama3.22025.12 | 62.55 | |
| Gemma32025.12 | 57.14 | |
| Mamba-2.8BBackbone=Mamba-2.8B, Pruning ratio=0%2024.03 | 35.97 | |
| GRASPCompression Ratio=25%, Post-training compensation=Yes, Evaluation Protocol=Zero-shot2024.12 | 35.1 | |
| LaCoTrain-Free=false, Base Model=Llama 2 7B, Compression Ratio=25%2025.05 | 34.4 | |
| UIDLTrain-Free=false, Base Model=Llama 2 7B, Compression Ratio=25%2025.05 | 34.4 | |
| LaCoCompression Ratio=25%, Post-training compensation=Yes, Evaluation Protocol=Zero-shot2024.12 | 34.4 | |
| ShortGPTCompression Ratio=25%, Post-training compensation=Yes, Evaluation Protocol=Zero-shot2024.12 | 34.4 | |
| LLMPrunerTrain-Free=false, Base Model=Llama 2 7B, Compression Ratio=25%2025.05 | 33.4 | |
| LLMPrunerCompression Ratio=25%, Post-training compensation=Yes, Evaluation Protocol=Zero-shot2024.12 | 33.4 | |
| ShortGPTBackbone=RWKV-7B, Pruning ratio=28.1%2024.03 | 33.11 | |
| Llama 2 7B (baseline)Base Model=Llama 2 7B, Compression Ratio=0%2025.05 | 33 | |
| LLM-StreamlineTrain-Free=false, Base Model=Llama 2 7B, Compression Ratio=25%2025.05 | 33 | |
| ReplaceMe (Cosine)Train-Free=true, Base Model=Llama 2 7B, Compression Ratio=25%2025.05 | 33 | |
| ReplaceMe (LS)Train-Free=true, Base Model=Llama 2 7B, Compression Ratio=25%2025.05 | 33 | |
| DenseCompression Ratio=0%, Post-training compensation=No, Evaluation Protocol=Zero-shot2024.12 | 33 | |
| LLM-Streamline-FFNCompression Ratio=25%, Post-training compensation=Yes, Evaluation Protocol=Zero-shot2024.12 | 33 | |
| LLM-Streamline-LayerCompression Ratio=25%, Post-training compensation=Yes, Evaluation Protocol=Zero-shot2024.12 | 33 | |
| ShortGPTBackbone=Mamba-2.8B, Pruning ratio=10.9%2024.03 | 32.95 | |
| ShortGPTBackbone=RWKV-7B, Pruning ratio=9.4%2024.03 | 32.6 | |
| ShortGPTBackbone=RWKV-7B, Pruning ratio=25%2024.03 | 32.41 | |
| ShortGPTBackbone=RWKV-7B, Pruning ratio=18.8%2024.03 | 32.11 | |
| RWKV-7BBackbone=RWKV-7B, Pruning ratio=0%2024.03 | 32.07 | |
| SliceGPTTrain-Free=false, Base Model=Llama 2 7B, Compression Ratio=25%2025.05 | 31.6 | |
| SliceGPTCompression Ratio=25%, Post-training compensation=Yes, Evaluation Protocol=Zero-shot2024.12 | 31.6 | |
| ShortGPTBackbone=Mamba-2.8B, Pruning ratio=20.3%2024.03 | 31.29 | |
| ShortGPTBackbone=Mamba-2.8B, Pruning ratio=25%2024.03 | 29.96 | |
| ShortGPTBackbone=Mamba-2.8B, Pruning ratio=31.3%2024.03 | 28.25 |