List your company
ResearchFormerly WizWand

High-load generation workload

Benchmarks

TaskDatasetSOTA resultTrendResults
LLM Serving
High-load generation workload w/ NVLink
443TTFT (ms)
27
LLM Serving
High-load generation workload w/o NVLink
878Time To First Token (ms)
27