Token-level Reconstruction on Salesforce/wikitext-103 Semi-OOD (val)
47.76Reconstruction Accuracy (TRA)87M parameter Transformer Autoencoder
Evaluation results
| Method | Links | |
|---|---|---|
| 87M parameter Transformer AutoencoderNumber of Parameters=87M, Validation Tokens=320,512, Data Distribution=Semi-OOD (Wiki)2025.12 | 47.76 |