ResearchTasksLLM Serving PerformanceFollowBenchmarksDataset NameSOTA MethodSortMost resultsRecently updatedMost papersApplyDataset NameSOTA methodMetricTrendResultsLast UpdatedQwen 7B Uniform distribution 32 model variants 2.5Delta-CoMe0.86Throughput (req/s)6Feb 26, 2026Qwen 7B (Zipf distribution, alpha=1.5) 2.5 (32 model variants)Delta-CoMe0.87Throughput (req/s)6Feb 26, 2026
Qwen 7B (Zipf distribution, alpha=1.5) 2.5 (32 model variants)Delta-CoMe0.87Throughput (req/s)6Feb 26, 2026