ResearchDatasetsLLM Generation ThroughputFollowBenchmarksTask NameDataset NameSOTA MethodSortMost resultsRecently updatedMost papersApplyTask NameDataset NameSOTA ResultTrendResultsEnd-to-end generationLLM Generation Throughput751Throughput (tokens/s)10