Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Time To First Token (TTFT) Latency research benchmarks · SOTA2 Research

Time To First Token (TTFT) Latency

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

Controlled synthetic corpus Config B 1.0 (test)

40.1TTFT p50

4

Jun 19, 2026

Controlled synthetic corpus Config A 1.0 (test)

57.9TTFT p50 Latency

4

Jun 19, 2026

Llama 8B 8K Shared Context 3.1

Q4 cache reload

24.8TTFT (ms)

4

May 6, 2026

Llama 8B 4K Shared Context 3.1

Q4 cache reload

24.7TTFT (ms)

4

May 6, 2026

Llama 8B 1K Shared Context 3.1

FP16 cache copy

21.7TTFT (ms)

4

May 6, 2026

Popular datasets

Llama Controlled synthetic corpus

Follow for updates

Join SOTA2 Contact