ResearchTasksDecode LatencyDecode LatencyFollowBenchmarksDatasetSOTA methodSortMost resultsRecently updatedMost papersApplyDatasetSOTA methodMetricTrendResultsLast updatedDecode Latency BenchmarkDense Softmax 1.3B6.2Decode Latency (ms/tok)12May 12, 2026