ResearchDatasetsInference ScenarioFollowBenchmarksTask NameDataset NameSOTA MethodSortMost resultsRecently updatedMost papersApplyTask NameDataset NameSOTA ResultTrendResultsLLM Inference ThroughputInference Scenario 64K/64K2.82Speedup2