ResearchTasksLLM Inference SchedulingLLM Inference SchedulingFollowBenchmarksDatasetSOTA methodSortMost resultsRecently updatedMost papersApplyDatasetSOTA methodMetricTrendResultsLast updatedAlpacaOracle SJF0.158P90 Per-token Latency (s/token)20Jun 29, 2026LMSYS-Chat-1MOracle SJF0.143Average Per-token Latency (s/token)16Jun 29, 2026Reasoning and Azure tracesUniBoost-19.1Mean End-to-End Latency5Jun 18, 2026