Model Compression Time on WikiText
196.34Compression Time (s)COALA
Evaluation results
| Method | Links | |
|---|---|---|
| COALAModel=LLaMA3-1B, #Samples=642025.07 | 196.34 | |
| SVD-LLMModel=LLaMA3-1B, #Samples=642025.07 | 273.93 | |
| SVD-LLM V2Model=LLaMA3-1B, #Samples=642025.07 | 404.88 | |
| COALAModel=LLaMA3-8B, #Samples=1282025.07 | 1,811 | |
| SVD-LLMModel=LLaMA3-8B, #Samples=1282025.07 | 3,624.88 | |
| SVD-LLM V2Model=LLaMA3-8B, #Samples=1282025.07 | 4,210.5 |