Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Inference Latency research benchmarks – Page 2 · SOTA2 Research

Inference Latency

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

VLM decode average

21.1Latency (ms)

3

Feb 26, 2026

Obstacle-free (test)

6.74Latency (ms)

2

Jun 8, 2026

VLM prefill 1024 tokens

92.7Latency (ms)

2

Feb 26, 2026

VLM prefill 512 tokens

59.4Prefill Latency (ms)

2

Feb 26, 2026

ViT encoder prefill 729 tokens

9.7Latency (ms)

2

Feb 26, 2026

NN-Lite (Android TFLite)

100Conversion Success Rate

1

Jul 9, 2026

CIFAR-100 (test)

—

—Latency (s)

0

Feb 26, 2026

Page 2 of 2

Popular datasets

384 x 1248 OPT ImageNet CIFAR VLM prefill

Follow for updates

Join SOTA2 Contact