List your company

Prefill Compute Efficiency on Cloud TPU v6e

15.23Prefill MFUMamba2 2.7B
5.85968.292310.72513.1577Mar 10, 2026

Evaluation results

MethodLinks
Mamba2 2.7BPrompt Length=1024, Model size=2.7B, Batch size=1, Precision=BF16, Peak TFLOPS=9182026.0315.23
Mamba2 2.7BPrompt Length=4096, Model size=2.7B, Batch size=1, Precision=BF16, Peak TFLOPS=9182026.0312.96
Mamba2 1.3BPrompt Length=1024, Model size=1.3B, Batch size=1, Precision=BF16, Peak TFLOPS=9182026.0312.53
Mamba2 1.3BPrompt Length=4096, Model size=1.3B, Batch size=1, Precision=BF16, Peak TFLOPS=9182026.0311.67
Mamba2 780MPrompt Length=4096, Model size=780M, Batch size=1, Precision=BF16, Peak TFLOPS=9182026.0311.33
Mamba2 780MPrompt Length=1024, Model size=780M, Batch size=1, Precision=BF16, Peak TFLOPS=9182026.0310.62
Mamba2 2.7BPrompt Length=8192, Model size=2.7B, Batch size=1, Precision=BF16, Peak TFLOPS=9182026.039.71
Mamba2 370MPrompt Length=4096, Model size=370M, Batch size=1, Precision=BF16, Peak TFLOPS=9182026.039.04
Mamba2 1.3BPrompt Length=8192, Model size=1.3B, Batch size=1, Precision=BF16, Peak TFLOPS=9182026.038.39
Mamba2 130MPrompt Length=4096, Model size=130M, Batch size=1, Precision=BF16, Peak TFLOPS=9182026.038.23
Mamba2 780MPrompt Length=8192, Model size=780M, Batch size=1, Precision=BF16, Peak TFLOPS=9182026.038.2
Mamba2 130MPrompt Length=8192, Model size=130M, Batch size=1, Precision=BF16, Peak TFLOPS=9182026.037.68
Mamba2 370MPrompt Length=8192, Model size=370M, Batch size=1, Precision=BF16, Peak TFLOPS=9182026.037.6
Mamba2 370MPrompt Length=1024, Model size=370M, Batch size=1, Precision=BF16, Peak TFLOPS=9182026.037.47
Mamba2 130MPrompt Length=1024, Model size=130M, Batch size=1, Precision=BF16, Peak TFLOPS=9182026.036.22