Latency Evaluation
Benchmarks
DatasetSOTA methodMetricTrendResultsLast updated
27Latency (s)
13
Feb 26, 2026
0.4Latency (s)
13
Feb 26, 2026
0.67Latency (s)
12
Feb 26, 2026
0Broker-Only p50 Latency
8
Jun 19, 2026
3.86End-to-End Latency
6
Feb 26, 2026
2.1End-to-End Latency
6
Feb 26, 2026
0.28TTFT P50
2
Apr 10, 2026