ResearchTasksLLM Serving PerformanceLLM Serving PerformanceFollowBenchmarksDatasetSOTA methodSortMost resultsRecently updatedMost papersApplyDatasetSOTA methodMetricTrendResultsLast updatedQwen 7B Uniform distribution 32 model variants 2.5Delta-CoMe0.86Throughput (req/s)6Feb 26, 2026Qwen 7B (Zipf distribution, alpha=1.5) 2.5 (32 model variants)Delta-CoMe0.87Throughput (req/s)6Feb 26, 2026
Qwen 7B (Zipf distribution, alpha=1.5) 2.5 (32 model variants)Delta-CoMe0.87Throughput (req/s)6Feb 26, 2026