List your company

ResearchFormerly WizWand

Attention Operator Performance

Benchmarks

DatasetSOTA methodMetricTrendResultsLast updated

MLA 128 Head Dimension Sequence Length 16k

175.9TFLOPS

4

Feb 26, 2026

MLA Sequence Length 8k 128 Head Dimension

164.3TFLOPS

4

Feb 26, 2026

MLA 128 Head Dimension Sequence Length 4k

138.6TFLOPS

4

Feb 26, 2026

MLA 128 Head Dimension Sequence Length 2k

108.2TFLOPS

4

Feb 26, 2026

MLA 128 Head Dimension Sequence Length 1k

78.6TFLOPS

4

Feb 26, 2026

MLA Sequence Length 512 128 Head Dimension

50.6TFLOPS

4

Feb 26, 2026