MLA
Benchmarks
TaskDatasetSOTA resultTrendResults
MLA 128 Head Dimension Sequence Length 16k
175.9TFLOPS
4
MLA Sequence Length 8k 128 Head Dimension
164.3TFLOPS
4
MLA 128 Head Dimension Sequence Length 4k
138.6TFLOPS
4
MLA 128 Head Dimension Sequence Length 2k
108.2TFLOPS
4
MLA 128 Head Dimension Sequence Length 1k
78.6TFLOPS
4
MLA Sequence Length 512 128 Head Dimension
50.6TFLOPS
4