Multi-turn Inference Latency
Benchmarks
DatasetSOTA methodMetricTrendResultsLast updated
1.2Average Latency (Demand Turns) (ms)
10
Apr 10, 2026
1.2Average Latency (Demand Turns) (ms)
10
Apr 10, 2026
1,500Average Latency (Demand Turns)
10
Apr 10, 2026
1.4Average Latency (Demand Turns) (ms)
10
Apr 10, 2026
1,400Average Latency (Demand Turns) (ms)
10
Apr 10, 2026