ResearchDatasetsLLM Generation ThroughputLLM Generation ThroughputFollowBenchmarksTaskDatasetSOTA methodSortMost resultsRecently updatedMost papersApplyTaskDatasetSOTA resultTrendResultsEnd-to-end generationLLM Generation Throughput751Throughput (tokens/s)10