Question Answering on TruthfulQA (BLEU)
49BLEU ScoreOriginal
Evaluation Results
| Method | Links | |
|---|---|---|
| OriginalBackbone Model=Llama-3.1-8B, Compression Rate=None2024.11 | 49 | |
| SVD-LLM V2Backbone Model=Llama-3.1-8B, Compression Rate=20%2024.11 | 46 | |
| FiPSBackbone Model=Llama-3.1-8B, Compression Rate=20%2024.11 | 46 | |
| SVD-LLMBackbone Model=Llama-3.1-8B, Compression Rate=20%2024.11 | 45 | |
| ASVDBackbone Model=Llama-3.1-8B, Compression Rate=20%2024.11 | 37 | |
| OriginalBackbone Model=Llama-7B, Compression Rate=None2024.11 | 30 | |
| SVD-LLM V2Backbone Model=Llama-7B, Compression Rate=20%2024.11 | 27 | |
| FiPSBackbone Model=Llama-7B, Compression Rate=20%2024.11 | 27 | |
| SVD-LLMBackbone Model=Llama-7B, Compression Rate=20%2024.11 | 24 | |
| ASVDBackbone Model=Llama-7B, Compression Rate=20%2024.11 | 21 |