Decoding Throughput
Benchmarks
Dataset NameSOTA methodMetricTrendResultsLast Updated
2,087Throughput (tok/s)
27
Jun 2, 2026
1,763.9Throughput (tok/s)
27
Jun 2, 2026
188Decoding Throughput (TOK/s)
6
Feb 26, 2026
225.01Throughput (TOK/s)
5
May 12, 2026
196.8Throughput (tokens/sec)
5
May 12, 2026
231.3Throughput (tokens/sec)
5
May 12, 2026
316.9Decoding Throughput (tokens/sec)
5
May 12, 2026
23.5Throughput (TOK/s)
5
Feb 26, 2026
88.8AR Throughput (tok/s)
2
Mar 4, 2026
88.8AR Throughput (tok/s)
2
Mar 4, 2026