List your company
ResearchFormerly WizWand

Memory-bandwidth efficiency measurement on Autoregressive decoding workload

64.08HBU (%)Mamba-2-JAX
51.121654.485857.8561.2142Mar 10, 2026
Updated 7mo ago

Evaluation results

MethodLinks
Mamba-2-JAXModel=2.7B, Sequence Length=4096, Hardware=TPU v6e2026.0364.08
Mamba-2-JAXModel=2.7B, Sequence Length=2048, Hardware=TPU v6e2026.0364.06
Mamba-2-JAXModel=2.7B, Sequence Length=1024, Hardware=TPU v6e2026.0364
Mamba-2-JAXModel=2.7B, Sequence Length=512, Hardware=TPU v6e2026.0363.91
Mamba-2-JAXModel=2.7B, Sequence Length=256, Hardware=TPU v6e2026.0363.74
Mamba-2-JAXModel=2.7B, Sequence Length=128, Hardware=TPU v6e2026.0363.43
Mamba-2-JAXModel=780M, Sequence Length=4096, Hardware=TPU v6e2026.0362.99
Mamba-2-JAXModel=780M, Sequence Length=2048, Hardware=TPU v6e2026.0362.93
Mamba-2-JAXModel=780M, Sequence Length=1024, Hardware=TPU v6e2026.0362.87
Mamba-2-JAXModel=780M, Sequence Length=512, Hardware=TPU v6e2026.0362.8
Mamba-2-JAXModel=780M, Sequence Length=256, Hardware=TPU v6e2026.0362.59
Mamba-2-JAXModel=780M, Sequence Length=128, Hardware=TPU v6e2026.0362.07
Mamba-2-JAXModel=1.3B, Sequence Length=4096, Hardware=TPU v6e2026.0361.87
Mamba-2-JAXModel=1.3B, Sequence Length=2048, Hardware=TPU v6e2026.0361.86
Mamba-2-JAXModel=1.3B, Sequence Length=1024, Hardware=TPU v6e2026.0361.77
Mamba-2-JAXModel=1.3B, Sequence Length=512, Hardware=TPU v6e2026.0361.69
Mamba-2-JAXModel=1.3B, Sequence Length=256, Hardware=TPU v6e2026.0361.55
Mamba-2-JAXModel=1.3B, Sequence Length=128, Hardware=TPU v6e2026.0361.22
Mamba-2-JAXModel=370M, Sequence Length=2048, Hardware=TPU v6e2026.0359.32
Mamba-2-JAXModel=370M, Sequence Length=4096, Hardware=TPU v6e2026.0359.32
Mamba-2-JAXModel=370M, Sequence Length=1024, Hardware=TPU v6e2026.0359.29
Mamba-2-JAXModel=370M, Sequence Length=512, Hardware=TPU v6e2026.0359.07
Mamba-2-JAXModel=370M, Sequence Length=256, Hardware=TPU v6e2026.0358.65
Mamba-2-JAXModel=370M, Sequence Length=128, Hardware=TPU v6e2026.0357.88
Mamba-2-JAXModel=130M, Sequence Length=4096, Hardware=TPU v6e2026.0353.32
Mamba-2-JAXModel=130M, Sequence Length=2048, Hardware=TPU v6e2026.0353.26
Mamba-2-JAXModel=130M, Sequence Length=1024, Hardware=TPU v6e2026.0353.13
Mamba-2-JAXModel=130M, Sequence Length=512, Hardware=TPU v6e2026.0352.87
Mamba-2-JAXModel=130M, Sequence Length=256, Hardware=TPU v6e2026.0352.29
Mamba-2-JAXModel=130M, Sequence Length=128, Hardware=TPU v6e2026.0351.62