Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Interactive Serving research benchmarks · SOTA2 Research

Interactive Serving

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

Llama 3.1-8B-Instruct 512 -> 128 tokens, concurrency=1

Pre-comp. clustering rebuild

269Throughput (Tok/s)

6

Mar 19, 2026

Popular datasets

Follow for updates

Join SOTA2 Contact