# Prefill Compute Efficiency on Cloud TPU v6e

Source: [Prefill Compute Efficiency on Cloud TPU v6e](<https://www.sota2.com/research/sota/prefill-compute-efficiency-on-cloud-tpu-v6e>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-11T06:13:24.863Z

Evaluation of LLM prefill compute efficiency, measured by Model Flops Utilization (MFU), specifically on the Cloud TPU v6e accelerator.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Prefill Compute Efficiency |
| Dataset (including any stated split) | Cloud TPU v6e |
| Metric | Prefill MFU |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 15 of 15 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Prefill MFU](<https://www.sota2.com/research/sota/prefill-compute-efficiency-on-cloud-tpu-v6e.md?metric=Prefill%20MFU>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Prefill MFU | Result date | Report paper |
| --- | --- | --- | --- |
| Mamba2 2.7B | 15.23 | Not recorded | 69b0f72e2d603e6de3e45fb8 |
| Mamba2 2.7B | 12.96 | Not recorded | 69b0f72e2d603e6de3e45fb8 |
| Mamba2 1.3B | 12.53 | Not recorded | 69b0f72e2d603e6de3e45fb8 |
| Mamba2 1.3B | 11.67 | Not recorded | 69b0f72e2d603e6de3e45fb8 |
| Mamba2 780M | 11.33 | Not recorded | 69b0f72e2d603e6de3e45fb8 |
| Mamba2 780M | 10.62 | Not recorded | 69b0f72e2d603e6de3e45fb8 |
| Mamba2 2.7B | 9.71 | Not recorded | 69b0f72e2d603e6de3e45fb8 |
| Mamba2 370M | 9.04 | Not recorded | 69b0f72e2d603e6de3e45fb8 |
| Mamba2 1.3B | 8.39 | Not recorded | 69b0f72e2d603e6de3e45fb8 |
| Mamba2 130M | 8.23 | Not recorded | 69b0f72e2d603e6de3e45fb8 |
| Mamba2 780M | 8.2 | Not recorded | 69b0f72e2d603e6de3e45fb8 |
| Mamba2 130M | 7.68 | Not recorded | 69b0f72e2d603e6de3e45fb8 |
| Mamba2 370M | 7.6 | Not recorded | 69b0f72e2d603e6de3e45fb8 |
| Mamba2 370M | 7.47 | Not recorded | 69b0f72e2d603e6de3e45fb8 |
| Mamba2 130M | 6.22 | Not recorded | 69b0f72e2d603e6de3e45fb8 |

### Mamba2 2.7B

Prefill MFU: 15.23. Result ID: 69b107ed6dbb7075b95aa458.

[Reporting paper](<https://www.sota2.com/research/paper/69b0f72e2d603e6de3e45fb8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69b0f72e2d603e6de3e45fb8.md>)

[Implementation](<https://github.com/CosmoNaught/mamba2-jax>)

Recorded evaluation configuration: {"Prompt Length":"1024","Model size":"2.7B","Batch size":"1","Precision":"BF16","Peak TFLOPS":"918"}. This record does not assert independent reproduction.

### Mamba2 2.7B

Prefill MFU: 12.96. Result ID: 69b107ed6dbb7075b95aa459.

[Reporting paper](<https://www.sota2.com/research/paper/69b0f72e2d603e6de3e45fb8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69b0f72e2d603e6de3e45fb8.md>)

[Implementation](<https://github.com/CosmoNaught/mamba2-jax>)

Recorded evaluation configuration: {"Prompt Length":"4096","Model size":"2.7B","Batch size":"1","Precision":"BF16","Peak TFLOPS":"918"}. This record does not assert independent reproduction.

### Mamba2 1.3B

Prefill MFU: 12.53. Result ID: 69b107ed6dbb7075b95aa455.

[Reporting paper](<https://www.sota2.com/research/paper/69b0f72e2d603e6de3e45fb8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69b0f72e2d603e6de3e45fb8.md>)

[Implementation](<https://github.com/CosmoNaught/mamba2-jax>)

Recorded evaluation configuration: {"Prompt Length":"1024","Model size":"1.3B","Batch size":"1","Precision":"BF16","Peak TFLOPS":"918"}. This record does not assert independent reproduction.

### Mamba2 1.3B

Prefill MFU: 11.67. Result ID: 69b107ed6dbb7075b95aa456.

[Reporting paper](<https://www.sota2.com/research/paper/69b0f72e2d603e6de3e45fb8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69b0f72e2d603e6de3e45fb8.md>)

[Implementation](<https://github.com/CosmoNaught/mamba2-jax>)

Recorded evaluation configuration: {"Prompt Length":"4096","Model size":"1.3B","Batch size":"1","Precision":"BF16","Peak TFLOPS":"918"}. This record does not assert independent reproduction.

### Mamba2 780M

Prefill MFU: 11.33. Result ID: 69b107ed6dbb7075b95aa453.

[Reporting paper](<https://www.sota2.com/research/paper/69b0f72e2d603e6de3e45fb8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69b0f72e2d603e6de3e45fb8.md>)

[Implementation](<https://github.com/CosmoNaught/mamba2-jax>)

Recorded evaluation configuration: {"Prompt Length":"4096","Model size":"780M","Batch size":"1","Precision":"BF16","Peak TFLOPS":"918"}. This record does not assert independent reproduction.

### Mamba2 780M

Prefill MFU: 10.62. Result ID: 69b107ed6dbb7075b95aa452.

[Reporting paper](<https://www.sota2.com/research/paper/69b0f72e2d603e6de3e45fb8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69b0f72e2d603e6de3e45fb8.md>)

[Implementation](<https://github.com/CosmoNaught/mamba2-jax>)

Recorded evaluation configuration: {"Prompt Length":"1024","Model size":"780M","Batch size":"1","Precision":"BF16","Peak TFLOPS":"918"}. This record does not assert independent reproduction.

### Mamba2 2.7B

Prefill MFU: 9.71. Result ID: 69b107ed6dbb7075b95aa45a.

[Reporting paper](<https://www.sota2.com/research/paper/69b0f72e2d603e6de3e45fb8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69b0f72e2d603e6de3e45fb8.md>)

[Implementation](<https://github.com/CosmoNaught/mamba2-jax>)

Recorded evaluation configuration: {"Prompt Length":"8192","Model size":"2.7B","Batch size":"1","Precision":"BF16","Peak TFLOPS":"918"}. This record does not assert independent reproduction.

### Mamba2 370M

Prefill MFU: 9.04. Result ID: 69b107ed6dbb7075b95aa450.

[Reporting paper](<https://www.sota2.com/research/paper/69b0f72e2d603e6de3e45fb8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69b0f72e2d603e6de3e45fb8.md>)

[Implementation](<https://github.com/CosmoNaught/mamba2-jax>)

Recorded evaluation configuration: {"Prompt Length":"4096","Model size":"370M","Batch size":"1","Precision":"BF16","Peak TFLOPS":"918"}. This record does not assert independent reproduction.

### Mamba2 1.3B

Prefill MFU: 8.39. Result ID: 69b107ed6dbb7075b95aa457.

[Reporting paper](<https://www.sota2.com/research/paper/69b0f72e2d603e6de3e45fb8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69b0f72e2d603e6de3e45fb8.md>)

[Implementation](<https://github.com/CosmoNaught/mamba2-jax>)

Recorded evaluation configuration: {"Prompt Length":"8192","Model size":"1.3B","Batch size":"1","Precision":"BF16","Peak TFLOPS":"918"}. This record does not assert independent reproduction.

### Mamba2 130M

Prefill MFU: 8.23. Result ID: 69b107ed6dbb7075b95aa44d.

[Reporting paper](<https://www.sota2.com/research/paper/69b0f72e2d603e6de3e45fb8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69b0f72e2d603e6de3e45fb8.md>)

[Implementation](<https://github.com/CosmoNaught/mamba2-jax>)

Recorded evaluation configuration: {"Prompt Length":"4096","Model size":"130M","Batch size":"1","Precision":"BF16","Peak TFLOPS":"918"}. This record does not assert independent reproduction.

### Mamba2 780M

Prefill MFU: 8.2. Result ID: 69b107ed6dbb7075b95aa454.

[Reporting paper](<https://www.sota2.com/research/paper/69b0f72e2d603e6de3e45fb8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69b0f72e2d603e6de3e45fb8.md>)

[Implementation](<https://github.com/CosmoNaught/mamba2-jax>)

Recorded evaluation configuration: {"Prompt Length":"8192","Model size":"780M","Batch size":"1","Precision":"BF16","Peak TFLOPS":"918"}. This record does not assert independent reproduction.

### Mamba2 130M

Prefill MFU: 7.68. Result ID: 69b107ed6dbb7075b95aa44e.

[Reporting paper](<https://www.sota2.com/research/paper/69b0f72e2d603e6de3e45fb8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69b0f72e2d603e6de3e45fb8.md>)

[Implementation](<https://github.com/CosmoNaught/mamba2-jax>)

Recorded evaluation configuration: {"Prompt Length":"8192","Model size":"130M","Batch size":"1","Precision":"BF16","Peak TFLOPS":"918"}. This record does not assert independent reproduction.

### Mamba2 370M

Prefill MFU: 7.6. Result ID: 69b107ed6dbb7075b95aa451.

[Reporting paper](<https://www.sota2.com/research/paper/69b0f72e2d603e6de3e45fb8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69b0f72e2d603e6de3e45fb8.md>)

[Implementation](<https://github.com/CosmoNaught/mamba2-jax>)

Recorded evaluation configuration: {"Prompt Length":"8192","Model size":"370M","Batch size":"1","Precision":"BF16","Peak TFLOPS":"918"}. This record does not assert independent reproduction.

### Mamba2 370M

Prefill MFU: 7.47. Result ID: 69b107ed6dbb7075b95aa44f.

[Reporting paper](<https://www.sota2.com/research/paper/69b0f72e2d603e6de3e45fb8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69b0f72e2d603e6de3e45fb8.md>)

[Implementation](<https://github.com/CosmoNaught/mamba2-jax>)

Recorded evaluation configuration: {"Prompt Length":"1024","Model size":"370M","Batch size":"1","Precision":"BF16","Peak TFLOPS":"918"}. This record does not assert independent reproduction.

### Mamba2 130M

Prefill MFU: 6.22. Result ID: 69b107ed6dbb7075b95aa44c.

[Reporting paper](<https://www.sota2.com/research/paper/69b0f72e2d603e6de3e45fb8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69b0f72e2d603e6de3e45fb8.md>)

[Implementation](<https://github.com/CosmoNaught/mamba2-jax>)

Recorded evaluation configuration: {"Prompt Length":"1024","Model size":"130M","Batch size":"1","Precision":"BF16","Peak TFLOPS":"918"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
