Linear Regression In-context Learning on Garg Linear Regression (d=20)
99.9R^2Transformer
Evaluation results
| Method | Links | |
|---|---|---|
| TransformerTraining Steps=50k2026.07 | 99.9 | |
| Transformer2026.07 | 98.9 | |
| DendriCNN2026.07 | 83.3 | |
| DendriCLTraining Steps=50k2026.07 | 81.8 | |
| DendriCL2026.07 | 80.5 | |
| DendriCLNumber of Layers=22026.07 | 79.3 | |
| SpikformerTraining Steps=50k2026.07 | 78.6 | |
| Spikformer2026.07 | 72.4 | |
| Pure LIFTraining Steps=50k2026.07 | 63.5 | |
| Linear Tx2026.07 | 51.8 | |
| MLP-Mixer2026.07 | 13.6 | |
| Pure LIF2026.07 | 8.6 | |
| Active Dendrites2026.07 | 6.1 | |
| GRU2026.07 | 5.7 | |
| LTC2026.07 | 0.9 | |
| Pure MLP2026.07 | 0.9 | |
| LSNN2026.07 | 0.8 | |
| SpikingSSM2026.07 | 0.8 |