Time to First Token (TTFT)
Benchmarks
DatasetSOTA methodMetricTrendResultsLast updated
182Time to First Token (ms)
32
Jun 19, 2026
51TTFT (ms)
12
Jun 19, 2026
14.5TTFT (s)
9
Apr 21, 2026
12.7Time-to-First-Token (s)
9
Apr 21, 2026
10.9TTFT (s)
9
Apr 21, 2026
9.2TTFT (s)
9
Apr 21, 2026
7.2TTFT (s)
9
Apr 21, 2026
5.2TTFT (s)
9
Apr 21, 2026
3.4TTFT (s)
9
Apr 21, 2026
19.99TTFT (ms)
8
Feb 26, 2026
19.17TTFT (ms)
8
Feb 26, 2026
1,195.6TTFT (Standard, ms)
3
Jun 4, 2026