Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

End-to-end throughput research benchmarks · SOTA2 Research

End-to-end throughput

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

LLaMA-2-7B-Chat

449Throughput (tokens/sec)

60

Feb 26, 2026

Cloud Inference Workloads

824.22Throughput (tokens/s)

32

Feb 26, 2026

Popular datasets

Llama Cloud Inference Workloads

Follow for updates

Join SOTA2 Contact