Frobenius Reconstruction on Pythia Attention Output Projections 1.4B
0.269Dimensionless Reconstruction Error FractionPure-bundle GBD (λ = 0, untied)
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Pure-bundle GBD (λ = 0, untied)Layer coupling (tied/untied)=untied, Lambda (λ)=0, Compression ratio (d/D)=1/42026.05 | 0.269 | 37.2 | |
| SVD-LLM (per-layer)Layer coupling (tied/untied)=untied, Lambda (λ)=∞, Compression ratio (d/D)=1/42026.05 | 0.428 | — | |
| GBD-tied (for Theorem 2 verification)Layer coupling (tied/untied)=tied, Lambda (λ)=0, Compression ratio (d/D)=1/42026.05 | 0.669 | 4.5 | |
| Basis-Sharing-core (tied)Layer coupling (tied/untied)=tied, Lambda (λ)=∞, Compression ratio (d/D)=1/42026.05 | 0.701 | — |