Cloze Test on CHID (test)
41.6AccuracyLlama 2 7B (baseline)
Evaluation results
| Method | Links | |
|---|---|---|
| Llama 2 7B (baseline)Base Model=Llama 2 7B, Compression Ratio=0%2025.05 | 41.6 | |
| LaCoTrain-Free=false, Base Model=Llama 2 7B, Compression Ratio=25%2025.05 | 36.1 | |
| LLMPrunerTrain-Free=false, Base Model=Llama 2 7B, Compression Ratio=25%2025.05 | 28.4 | |
| ReplaceMe (Cosine)Train-Free=true, Base Model=Llama 2 7B, Compression Ratio=25%2025.05 | 25.2 | |
| LLM-StreamlineTrain-Free=false, Base Model=Llama 2 7B, Compression Ratio=25%2025.05 | 24.1 | |
| UIDLTrain-Free=false, Base Model=Llama 2 7B, Compression Ratio=25%2025.05 | 21.5 | |
| ReplaceMe (LS)Train-Free=true, Base Model=Llama 2 7B, Compression Ratio=25%2025.05 | 18.9 | |
| SliceGPTTrain-Free=false, Base Model=Llama 2 7B, Compression Ratio=25%2025.05 | 18.5 |