ResearchDatasetsCloud Inference WorkloadsFollowBenchmarksTask NameDataset NameSOTA MethodSortMost resultsRecently updatedMost papersApplyTask NameDataset NameSOTA ResultTrendResultsEnd-to-end throughputCloud Inference Workloads824.22Throughput (tokens/s)32