ResearchDatasets64K/64K serving scenario64K/64K serving scenarioFollowBenchmarksTaskDatasetSOTA methodSortMost resultsRecently updatedMost papersApplyTaskDatasetSOTA resultTrendResultsMax token throughput64K/64K serving scenario 8xH100 node 1.09.3Max Throughput (K tok/s)5