ResearchDatasetsvLLM ThroughputFollowBenchmarksTask NameDataset NameSOTA MethodSortMost resultsRecently updatedMost papersApplyTask NameDataset NameSOTA ResultTrendResultsThroughput BenchmarkingvLLM Throughput 1,000 input / 1,000 output tokens2.42Throughput (req/s)3