ResearchDatasetsvLLM ThroughputvLLM ThroughputFollowBenchmarksTaskDatasetSOTA methodSortMost resultsRecently updatedMost papersApplyTaskDatasetSOTA resultTrendResultsThroughput BenchmarkingvLLM Throughput 1,000 input / 1,000 output tokens2.42Throughput (req/s)3