Frobenius reconstruction on Pythia attention output projections 70M
16.8Reconstruction Error FractionPure-bundle GBD (λ = 0, untied)
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Pure-bundle GBD (λ = 0, untied)Layer coupling (tied/untied)=untied, Lambda (λ)=0, Compression ratio (d/D)=1/42026.05 | 16.8 | 46.4 | |
| SVD-LLM (per-layer)Layer coupling (tied/untied)=untied, Lambda (λ)=∞, Compression ratio (d/D)=1/42026.05 | 31.4 | — | |
| GBD-tied (for Theorem 2 verification)Layer coupling (tied/untied)=tied, Lambda (λ)=0, Compression ratio (d/D)=1/42026.05 | 48.4 | 17.6 | |
| Basis-Sharing-core (tied)Layer coupling (tied/untied)=tied, Lambda (λ)=∞, Compression ratio (d/D)=1/42026.05 | 58.7 | — |