Sequence regression on Synthetic autoregressive multi-frequency sequences N=32 (test)
0.003Test MSEPyTorch Transformer (Self-Attn)
Evaluation Results
| Method | Links | |
|---|---|---|
| PyTorch Transformer (Self-Attn)Trainable Params=> 1, 000, Mixing Complexity=O(T^2)2026.03 | 0.003 | |
| Phasor Transformer (DFT)Trainable Params=50, Mixing Complexity=O(T log T)2026.03 | 0.07 |