Question Answering on ARC-e, ARC-c, BoolQ, HeadQA, OBQA (test)
31.3ARC-e AccuracySpikeLLM-7B
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| SpikeLLM-7BSpike-Driven=false, T=42026.04 | 31.3 | 23.6 | 53.8 | — | — | — | — | |
| WD-Spikingformer-0.4BSpike-Driven=true, T=42026.04 | 30 | 22.3 | 37.8 | 26 | 26.1 | 28.4 | 238.4 | |
| Qwen-1.5BSpike-Driven=false2026.04 | 26.2 | 26.9 | 60.3 | 25.7 | 27.1 | 33.2 | 3,398.3 |