Language Modeling on WikiText-103 (PPL and Spiking Rate)
20.51Perplexity (PPL)Transformer
Evaluation results
| Method | Links | ||
|---|---|---|---|
| TransformerSNN=No, Params=231M2026.06 | 20.51 | — | |
| S4SNN=No, Params=249M2026.06 | 20.95 | — | |
| LongSpikeSNN=Yes, Params=75M2026.06 | 32.31 | 27.05 | |
| SpikingSSMSNN=Yes, Params=75M2026.06 | 33.94 | 26.4 | |
| SpikeGPTSNN=Yes, Params=213M2026.06 | 39.75 | — |