Inference Latency
Benchmarks
DatasetSOTA methodMetricTrendResultsLast updated
21.1Latency (ms)
3
Feb 26, 2026
6.74Latency (ms)
2
Jun 8, 2026
92.7Latency (ms)
2
Feb 26, 2026
59.4Prefill Latency (ms)
2
Feb 26, 2026
9.7Latency (ms)
2
Feb 26, 2026
100Conversion Success Rate
1
Jul 9, 2026
—
—Latency (s)
0
Feb 26, 2026