ResearchDatasetsInference ScenarioInference ScenarioFollowBenchmarksTaskDatasetSOTA methodSortMost resultsRecently updatedMost papersApplyTaskDatasetSOTA resultTrendResultsLLM Inference ThroughputInference Scenario 64K/64K2.82Speedup2