LLM Multi-Agent high-throughput serving on ProtocolBench Streaming Queue scenario
2,375Duration (s)ProtocolRouter
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| ProtocolRouterrouter=ACP2025.10 | 2,375 | 9,495 | 2,866 | |
| ACP2025.10 | 2,417 | 9,663 | 1,077 |
Loading the SOTA2 catalog…