Prefill Throughput
Benchmarks
Dataset NameSOTA methodMetricTrendResultsLast Updated
20,438.9Prefill Throughput (tok/s)
20
Jun 4, 2026
20,388.3Prefill Throughput (tok/s)
20
Jun 4, 2026
20,864.85Prefill Throughput (tokens/s)
15
Jun 5, 2026
7,756.8Prefill Throughput (tok/s)
10
Jun 4, 2026
7,959.4Prefill Throughput (tok/s)
10
Jun 4, 2026
9,576.2Prefill Throughput (tok/s)
10
Jun 4, 2026
48.01Throughput (Samples/s)
7
Jun 12, 2026