Decoding Latency
Benchmarks
Dataset NameSOTA methodMetricTrendResultsLast Updated
0.019Latency (16k Context)
16
Feb 26, 2026
0.024Decoding latency (s)
8
Feb 26, 2026
0.033Decoding Latency (s)
7
Feb 26, 2026
0.062Decoding Latency (s)
6
Feb 26, 2026
0.041Decoding Latency (s)
6
Feb 26, 2026
0.05Decoding Latency (s)
5
Feb 26, 2026
0.098Decoding Latency (s)
5
Feb 26, 2026
0.115Decoding Latency (s)
4
Feb 26, 2026