List your company
ResearchFormerly WizWand

Mathematical Reasoning on GSM8K (Str., Flex.)

48.64String Accuracy (Str.)LLaMA3-8B
0.103212.704125.30537.9059Apr 11, 2026
Updated 6mo ago

Evaluation results

MethodLinks
LLaMA3-8BSpike=✗, Bit=-, T x D=-, R=-, FLOPs (T)=7.97, Power (J)=36.672026.0448.6449.55
SDLLMBackbone=LLaMA3-8B, Spike=✓, Bit=6-1.58, T x D=1 × 32, R=0.213, FLOPs (T)=5.09, Power (J)=4.582026.0446.5547.16
SDLLMBackbone=LLaMA3-8B, Spike=✓, Bit=4-1.58, T x D=1 × 16, R=0.211, FLOPs (T)=1.68, Power (J)=1.512026.0431.8432.6
LLaMA2-13BSpike=✗, Bit=-, T x D=-, R=-, FLOPs (T)=13.42, Power (J)=61.742026.0422.7322.88
QuaRotBackbone=LLaMA2-13B, Spike=✗, Bit=6-6, T x D=-, R=-, FLOPs (T)=3.77, Power (J)=17.362026.0421.8221.97
SDLLMBackbone=LLaMA2-13B, Spike=✓, Bit=6-1.58, T x D=1 × 32, R=0.217, FLOPs (T)=8.74, Power (J)=7.862026.0421.5221.82
SDLLMBackbone=LLaMA2-13B, Spike=✓, Bit=4-1.58, T x D=1 × 16, R=0.215, FLOPs (T)=2.89, Power (J)=2.602026.0421.0621.36
SDLLMBackbone=LLaMA3-8B, Spike=✓, Bit=4-1.58, T x D=1 × 8, R=0.210, FLOPs (T)=0.84, Power (J)=0.752026.0418.819.41
SDLLMBackbone=LLaMA2-13B, Spike=✓, Bit=4-1.58, T x D=1 × 8, R=0.209, FLOPs (T)=1.40, Power (J)=1.262026.0415.9116.21
LLaMA2-7BSpike=✗, Bit=-, T x D=-, R=-, FLOPs (T)=6.91, Power (J)=31.772026.0415.315.3
SDLLMBackbone=LLaMA2-7B, Spike=✓, Bit=6-1.58, T x D=1 × 32, R=0.222, FLOPs (T)=4.60, Power (J)=4.142026.0414.8515.11
QuaRotBackbone=LLaMA2-7B, Spike=✗, Bit=6-6, T x D=-, R=-, FLOPs (T)=1.94, Power (J)=8.942026.0413.4813.79
QuaRotBackbone=LLaMA2-13B, Spike=✗, Bit=4-4, T x D=-, R=-, FLOPs (T)=1.68, Power (J)=7.722026.0412.4212.42
SDLLMBackbone=LLaMA2-7B, Spike=✓, Bit=4-1.58, T x D=1 × 16, R=0.221, FLOPs (T)=1.53, Power (J)=1.372026.041010.15
SDLLMBackbone=LLaMA2-7B, Spike=✓, Bit=4-1.58, T x D=1 × 8, R=0.216, FLOPs (T)=0.75, Power (J)=0.672026.046.366.67
QuaRotBackbone=LLaMA2-7B, Spike=✗, Bit=4-4, T x D=-, R=-, FLOPs (T)=0.86, Power (J)=3.972026.041.972.73