ResearchTasksLLM Multi-Agent high-throughput servingFollowBenchmarksDataset NameSOTA MethodSortMost resultsRecently updatedMost papersApplyDataset NameSOTA methodMetricTrendResultsLast UpdatedProtocolBench Streaming Queue scenarioProtocolRouter2,375Duration (s)2Jun 4, 2026