Token-level Reconstruction on High-entropy random token sequences Full-OOD
57Reconstruction Accuracy (TRA)87M parameter Transformer Autoencoder
Evaluation results
| Method | Links | |
|---|---|---|
| 87M parameter Transformer AutoencoderNumber of Parameters=87M, Validation Tokens=3,170,816, Data Distribution=Full-OOD (Random)2025.12 | 57 |