Representational Alignment on Nemotron 3 Nano Internal Activations
1Avg. CKABF16 (Teacher)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| BF16 (Teacher)measurement=Linear CKA on centered decoder block activations, normalization=[0, 1], probes=configured decoder block output probes2026.06 | 1 | 1 | |
| CKA-QADmeasurement=Linear CKA on centered decoder block activations, normalization=[0, 1], probes=configured decoder block output probes2026.06 | 0.994 | 0.985 | |
| NVFP4 PTQmeasurement=Linear CKA on centered decoder block activations, normalization=[0, 1], probes=configured decoder block output probes2026.06 | 0.993 | 0.983 | |
| QAD (KL-only)measurement=Linear CKA on centered decoder block activations, normalization=[0, 1], probes=configured decoder block output probes2026.06 | 0.958 | 0.74 |