List your company

ResearchFormerly WizWand

Prefill Latency

Benchmarks

DatasetSOTA methodMetricTrendResultsLast updated

Llama-3-8B 500 Mbps

1.485Prefill Latency (s)

8

May 28, 2026

Llama-3-8B 200 Mbps

1.541Prefill Latency (s)

8

May 28, 2026

Llama-3-8B 100 Mbps

1.545Prefill Latency (s)

8

May 28, 2026

Llama-3-8B 50 Mbps

1.547Prefill Latency (s)

8

May 28, 2026

Llama-3-8B 20 Mbps

1.549Prefill Latency (s)

8

May 28, 2026

Llama-3-8B 10 Mbps

1.563Prefill Latency (s)

8

May 28, 2026

1,797.4Prefill Latency (ms)

5

Mar 23, 2026