Language Modeling on WikiText-2 (LLaMA-2 7B)
5.12PPLANN Baseline
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ANN BaselinePrec.=FP322026.01 | 5.12 | — | |
| SpikeLLMPrec.=W4A4, Ch./Steps=42026.01 | 11.85 | 6.73 | |
| SpikeLLMPrec.=W2A16, Ch./Steps=42026.01 | 14.16 | 9.04 | |
| NEXUS (Ours Bit-Exact)Prec.=FP32, Ch./Steps=322026.01 | — | 0 |