Language Modeling on Evaluation Tasks Zero-shot Average
60.47Zero-shot Average AccuracySpikeLLM
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| SpikeLLMParams (B)=70.00, Spike Form=Integer (W2A16), Time Step=2, Zero-shot=true2026.04 | 60.47 | 82.55 | |
| SpikeLLMParams (B)=13.00, Spike Form=Integer (W2A16), Time Step=2, Zero-shot=true2026.04 | 53.76 | 81.34 | |
| SpikeLLMParams (B)=13.00, Spike Form=Integer (W2A8), Time Step=4, Zero-shot=true2026.04 | 50.12 | 75.78 | |
| SpikeLLMParams (B)=7.000, Spike Form=Integer (W2A16), Time Step=2, Zero-shot=true2026.04 | 49.92 | 78.17 | |
| BiSpikCLMParams (B)=1.300, Tokens (B)=10.0, Spike Form=Binary, Time Step=4, Zero-shot=true2026.04 | 42.19 | 84.84 | |
| TriSpikCLMParams (B)=1.300, Tokens (B)=10.0, Spike Form=Ternary, Time Step=4, Zero-shot=true2026.04 | 42.12 | 84.7 | |
| SpikeLLMParams (B)=7.000, Spike Form=Integer (W2A8), Time Step=4, Zero-shot=true2026.04 | 41.77 | 65.41 | |
| BiSpikCLMParams (B)=1.300, Tokens (B)=10.0, Spike Form=Binary, Time Step=2, Zero-shot=true2026.04 | 41.33 | 83.11 | |
| TriSpikCLMParams (B)=1.300, Tokens (B)=10.0, Spike Form=Ternary, Time Step=2, Zero-shot=true2026.04 | 41.08 | 82.6 | |
| TriSpikCLMParams (B)=0.350, Tokens (B)=2.0, Spike Form=Ternary, Time Step=4, Zero-shot=true2026.04 | 38.87 | 91.07 | |
| BiSpikCLMParams (B)=0.350, Tokens (B)=2.0, Spike Form=Binary, Time Step=4, Zero-shot=true2026.04 | 38.84 | 91 | |
| BiSpikCLMParams (B)=0.350, Tokens (B)=2.0, Spike Form=Binary, Time Step=2, Zero-shot=true2026.04 | 38.48 | 90.16 | |
| TriSpikCLMParams (B)=0.350, Tokens (B)=2.0, Spike Form=Ternary, Time Step=2, Zero-shot=true2026.04 | 38.14 | 89.36 | |
| BiSpikCLMParams (B)=0.125, Tokens (B)=1.0, Spike Form=Binary, Time Step=4, Zero-shot=true2026.04 | 36.5 | 94.56 | |
| TriSpikCLMParams (B)=0.125, Tokens (B)=1.0, Spike Form=Ternary, Time Step=4, Zero-shot=true2026.04 | 36.27 | 93.96 | |
| TriSpikCLMParams (B)=0.125, Tokens (B)=1.0, Spike Form=Ternary, Time Step=2, Zero-shot=true2026.04 | 36.11 | 93.55 | |
| BiSpikCLMParams (B)=0.125, Tokens (B)=1.0, Spike Form=Binary, Time Step=2, Zero-shot=true2026.04 | 36.05 | 93.39 |