ResearchDatasetsSynthetic workloadsSynthetic workloadsFollowBenchmarksTaskDatasetSOTA methodSortMost resultsRecently updatedMost papersApplyTaskDatasetSOTA resultTrendResultsLLM ServingSynthetic workloads (maximum serving capacity)12.8Throughput (req/s)6