ResearchDatasetsMulti-node InfiniBand clusterMulti-node InfiniBand clusterFollowBenchmarksTaskDatasetSOTA methodSortMost resultsRecently updatedMost papersApplyTaskDatasetSOTA resultTrendResultsLLM Inference LatencyMulti-node InfiniBand cluster (2x8-GPU servers) inference performance (test)0.939Time To First Token (TTFT) Mean (s)4
LLM Inference LatencyMulti-node InfiniBand cluster (2x8-GPU servers) inference performance (test)0.939Time To First Token (TTFT) Mean (s)4