ResearchDatasetsCloud Inference WorkloadsCloud Inference WorkloadsFollowBenchmarksTaskDatasetSOTA methodSortMost resultsRecently updatedMost papersApplyTaskDatasetSOTA resultTrendResultsEnd-to-end throughputCloud Inference Workloads824.22Throughput (tokens/s)32