ResearchDatasetsserving scenarioserving scenarioFollowBenchmarksTaskDatasetSOTA methodSortMost resultsRecently updatedMost papersApplyTaskDatasetSOTA resultTrendResultsText Generation64K 64K serving scenario Single H100 GPU0.8Throughput (K tok/s)5