Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

PrefixLM Attention research benchmarks · SOTA2 Research

PrefixLM Attention

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

Llama3.1 405B (q=128, k=8) (1k)

122.22PrefixLM Attention TFLOPS (1k)

4

May 7, 2026

Qwen2.5 72B (q=64, k=8) (1k)

103.61PrefixLM Attention Throughput (TFLOPS)

4

May 7, 2026

Llama2-7b (q=32, k=32) (8k)

163.7TFLOPS (PrefixLM Attention)

4

May 7, 2026

Popular datasets

Llama2 Qwen2.5 Llama3.1

Follow for updates

Join SOTA2 Contact