Perplexity Prediction on LLM Compression Performance Perplexity
0.736LOO RSVD-LLM
Evaluation results
| Method | Links | |
|---|---|---|
| SVD-LLMLayer Type=MLP2026.04 | 0.736 | |
| Vanilla SVDLayer Type=ATTN2026.04 | 0.622 | |
| SVD-LLMLayer Type=ATTN2026.04 | 0.592 | |
| ASVDLayer Type=MLP2026.04 | 0.579 | |
| ASVDLayer Type=ATTN2026.04 | 0.498 | |
| ASVDLayer Type=BOTH2026.04 | 0.457 | |
| ASVD-SRLayer Type=BOTH2026.04 | 0.285 | |
| SVD-LLMLayer Type=BOTH2026.04 | 0.15 | |
| ASVD-SRLayer Type=ATTN2026.04 | 0.065 | |
| Vanilla SVDLayer Type=MLP2026.04 | 0.046 | |
| ASVD-SRLayer Type=MLP2026.04 | -0.02 | |
| Vanilla SVDLayer Type=BOTH2026.04 | -0.06 |