Accuracy Prediction on LLM Compression Performance Accuracy
0.89LOO R ScoreASVD
Evaluation results
| Method | Links | |
|---|---|---|
| ASVDLayer Type=ATTN2026.04 | 0.89 | |
| ASVDLayer Type=MLP2026.04 | 0.839 | |
| ASVDLayer Type=BOTH2026.04 | 0.823 | |
| ASVDBest Formula=γ · ρ¯eff2026.04 | 0.773 | |
| SVD-LLMLayer Type=MLP2026.04 | 0.756 | |
| Vanilla SVDLayer Type=BOTH2026.04 | 0.718 | |
| SVD-LLMBest Formula=γ · ρ¯s2026.04 | 0.674 | |
| ASVD-SRLayer Type=ATTN2026.04 | 0.56 | |
| ASVD-SRLayer Type=MLP2026.04 | 0.542 | |
| SVD-LLMLayer Type=ATTN2026.04 | 0.536 | |
| Vanilla SVDLayer Type=ATTN2026.04 | 0.465 | |
| ASVD (stable ranks)Best Formula=γ · ρ¯eff2026.04 | 0.441 | |
| Vanilla SVDLayer Type=MLP2026.04 | 0.298 | |
| SVD-LLMLayer Type=BOTH2026.04 | 0.286 | |
| Vanilla SVDBest Formula=γ^2 + e^-γ2026.04 | 0.28 | |
| ASVD-SRLayer Type=BOTH2026.04 | 0.227 |