Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

LLM Prefill Throughput research benchmarks · SOTA2 Research

LLM Prefill Throughput

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

LLM Prefill Workload

175,000Prefill Throughput (cuBLASLt)

114

May 12, 2026

LLM Prompt Length 512 (pp512)

5,128Throughput (tok/s)

48

Jul 2, 2026

LLM Prompt Length 256 (pp256)

5,063Prefill Throughput (tok/s)

48

Jul 2, 2026

LLM Prompt Length 128 (pp128)

4,796Throughput (tok/s)

48

Jul 2, 2026

LLM Prompt Length 2048 (pp2048)

4,447Prefill Throughput (tok/s)

36

Jul 2, 2026

LLM Prompt Length 1024

4,748Prefill Throughput (tok/s)

36

Jul 2, 2026

Popular datasets

LLM Prompt LLM Prompt Length LLM Prefill Workload

Follow for updates

Join SOTA2 Contact