ResearchDatasets4K/4K Inference Scenario4K/4K Inference ScenarioFollowBenchmarksTaskDatasetSOTA methodSortMost resultsRecently updatedMost papersApplyTaskDatasetSOTA resultTrendResultsLLM Inference Throughput4K/4K Inference Scenario2.44Speedup3