Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

64K/64K serving scenario dataset and benchmarks · SOTA2 Research

Research Datasets

64K/64K serving scenario

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Max token throughput

64K/64K serving scenario 8xH100 node 1.0

9.3Max Throughput (K tok/s)

5

Popular tasks

Max token throughput

Follow for updates

Join SOTA2 Contact