List your company
ResearchFormerly WizWand

Language Modeling on Evaluation Tasks Zero-shot Average

60.47Zero-shot Average AccuracySpikeLLM
35.073241.666648.2654.8534Apr 14, 2026
Updated 5mo ago

Evaluation results

MethodLinks
SpikeLLMParams (B)=70.00, Spike Form=Integer (W2A16), Time Step=2, Zero-shot=true2026.0460.4782.55
SpikeLLMParams (B)=13.00, Spike Form=Integer (W2A16), Time Step=2, Zero-shot=true2026.0453.7681.34
SpikeLLMParams (B)=13.00, Spike Form=Integer (W2A8), Time Step=4, Zero-shot=true2026.0450.1275.78
SpikeLLMParams (B)=7.000, Spike Form=Integer (W2A16), Time Step=2, Zero-shot=true2026.0449.9278.17
BiSpikCLMParams (B)=1.300, Tokens (B)=10.0, Spike Form=Binary, Time Step=4, Zero-shot=true2026.0442.1984.84
TriSpikCLMParams (B)=1.300, Tokens (B)=10.0, Spike Form=Ternary, Time Step=4, Zero-shot=true2026.0442.1284.7
SpikeLLMParams (B)=7.000, Spike Form=Integer (W2A8), Time Step=4, Zero-shot=true2026.0441.7765.41
BiSpikCLMParams (B)=1.300, Tokens (B)=10.0, Spike Form=Binary, Time Step=2, Zero-shot=true2026.0441.3383.11
TriSpikCLMParams (B)=1.300, Tokens (B)=10.0, Spike Form=Ternary, Time Step=2, Zero-shot=true2026.0441.0882.6
TriSpikCLMParams (B)=0.350, Tokens (B)=2.0, Spike Form=Ternary, Time Step=4, Zero-shot=true2026.0438.8791.07
BiSpikCLMParams (B)=0.350, Tokens (B)=2.0, Spike Form=Binary, Time Step=4, Zero-shot=true2026.0438.8491
BiSpikCLMParams (B)=0.350, Tokens (B)=2.0, Spike Form=Binary, Time Step=2, Zero-shot=true2026.0438.4890.16
TriSpikCLMParams (B)=0.350, Tokens (B)=2.0, Spike Form=Ternary, Time Step=2, Zero-shot=true2026.0438.1489.36
BiSpikCLMParams (B)=0.125, Tokens (B)=1.0, Spike Form=Binary, Time Step=4, Zero-shot=true2026.0436.594.56
TriSpikCLMParams (B)=0.125, Tokens (B)=1.0, Spike Form=Ternary, Time Step=4, Zero-shot=true2026.0436.2793.96
TriSpikCLMParams (B)=0.125, Tokens (B)=1.0, Spike Form=Ternary, Time Step=2, Zero-shot=true2026.0436.1193.55
BiSpikCLMParams (B)=0.125, Tokens (B)=1.0, Spike Form=Binary, Time Step=2, Zero-shot=true2026.0436.0593.39