ResearchDatasetsControlled tracesControlled tracesFollowBenchmarksTaskDatasetSOTA methodSortMost resultsRecently updatedMost papersApplyTaskDatasetSOTA resultTrendResultsGPU serving throughputControlled traces 8 streams 4096 prompt tokens 512 decode tokens274.61Throughput (tok/s)6
GPU serving throughputControlled traces 8 streams 4096 prompt tokens 512 decode tokens274.61Throughput (tok/s)6