Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

vLLM Model Deployment and Inference research benchmarks · SOTA2 Research

vLLM Model Deployment and Inference

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

Qwen3-32B inference vLLM

7.641Model Load Time (s)

3

Feb 26, 2026

Qwen3-14B vLLM (inference)

3.082Model Load Time (s)

3

Feb 26, 2026

Qwen3-8B vLLM inference

1.732Model Load Time (s)

3

Feb 26, 2026

Qwen3-4B vLLM (inference)

1.101Model Load Time (s)

3

Feb 26, 2026

Qwen3-1.7B vLLM (inference)

0.54Model Load Time (s)

3

Feb 26, 2026

Qwen3-0.6B vLLM inference

0.336Model Load Time (s)

3

Feb 26, 2026

Popular datasets

Follow for updates

Join SOTA2 Contact