Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

LLM Serving Latency research benchmarks · SOTA2 Research

LLM Serving Latency

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

ANNS Workload 2.0 QPS, 30x delays

0.72P50 Latency

13

Jul 9, 2026

Crawler Workload 4.0 QPS, 10x delays

0.64P50 Latency Score

13

Jul 9, 2026

Popular datasets

Crawler Workload ANNS Workload

Follow for updates

Join SOTA2 Contact