List your company

ResearchFormerly WizWand

vLLM Model Deployment and Inference

Benchmarks

DatasetSOTA methodMetricTrendResultsLast updated

Qwen3-32B inference vLLM

7.641Model Load Time (s)

3

Feb 26, 2026

Qwen3-14B vLLM (inference)

3.082Model Load Time (s)

3

Feb 26, 2026

Qwen3-8B vLLM inference

1.732Model Load Time (s)

3

Feb 26, 2026

Qwen3-4B vLLM (inference)

1.101Model Load Time (s)

3

Feb 26, 2026

Qwen3-1.7B vLLM (inference)

0.54Model Load Time (s)

3

Feb 26, 2026

Qwen3-0.6B vLLM inference

0.336Model Load Time (s)

3

Feb 26, 2026