Decode Throughput
Benchmarks
DatasetSOTA methodMetricTrendResultsLast updated
269.1Decode Throughput (tok/s)
9
Apr 24, 2026
117.3Throughput (tok/s)
6
Jul 2, 2026
295.4Throughput (TOK/s)
6
Jul 2, 2026
464.5Throughput (tok/s)
6
Jul 2, 2026
127.7Throughput (tok/s)
4
Jul 2, 2026
84.1Throughput (tokens/s)
3
Jul 2, 2026
69.3Throughput (tok/s)
3
Jul 2, 2026