ResearchDatasetsSynthetic workloadsFollowBenchmarksTask NameDataset NameSOTA MethodSortMost resultsRecently updatedMost papersApplyTask NameDataset NameSOTA ResultTrendResultsLLM ServingSynthetic workloads (maximum serving capacity)12.8Throughput (req/s)6