Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

GPU serving throughput research benchmarks · SOTA2 Research

GPU serving throughput

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

Controlled traces 8 streams 4096 prompt tokens 512 decode tokens

274.61Throughput (tok/s)

6

May 28, 2026

Popular datasets

Controlled traces

Follow for updates

Join SOTA2 Contact