ResearchTasksLarge Language Model Inference EfficiencyLarge Language Model Inference EfficiencyFollowBenchmarksDatasetSOTA methodSortMost resultsRecently updatedMost papersApplyDatasetSOTA methodMetricTrendResultsLast updatedAggregate of 16 datasets (test)Hybrid Verified126.2Throughput (tokens/s)5Jun 2, 2026