Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

LLM Inference Throughput research benchmarks · SOTA2 Research

LLM Inference Throughput

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

4K/4K Inference Scenario

gpt-oss-puzzle-88B

2.44Speedup

3

Feb 26, 2026

Inference Scenario 64K/64K

gpt-oss-puzzle-88B

2.82Speedup

2

Feb 26, 2026

Popular datasets

4K/4K Inference Scenario Inference Scenario

Follow for updates

Join SOTA2 Contact