Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Large Language Model Serving research benchmarks · SOTA2 Research

Large Language Model Serving

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

vLLM serving benchmark 128 prompts, 32 pre-fill tokens, 256 generation tokens

76TTFT (ms)

9

Apr 21, 2026

Popular datasets

vLLM serving benchmark

Follow for updates

Join SOTA2 Contact