In-Context Learning on Garg (d=10) (held-out tasks)
0.996R2Transformer (continuous attn)
Evaluation results
| Method | Links | |
|---|---|---|
| Transformer (continuous attn)Params=1.0M2026.07 | 0.996 | |
| Spikformer (spike attn)Params=1.0M2026.07 | 0.977 | |
| DendriCNN (continuous ablation)Params=0.75M2026.07 | 0.824 | |
| DendriCL (L = 2)Params=0.75M2026.07 | 0.811 | |
| DendriCL (single-layer)Params=0.75M2026.07 | 0.807 | |
| Pure LIFParams=1.0M2026.07 | 0.801 | |
| Active DendritesParams=1.29M2026.07 | 0.668 | |
| GRUParams=0.79M2026.07 | 0.666 | |
| LSNNParams=0.62M2026.07 | 0.011 |