ResearchDatasetsserving scenarioFollowBenchmarksTask NameDataset NameSOTA MethodSortMost resultsRecently updatedMost papersApplyTask NameDataset NameSOTA ResultTrendResultsText Generation64K 64K serving scenario Single H100 GPU0.8Throughput (K tok/s)5