ResearchDatasetsLong-Context LLM InferenceFollowBenchmarksTask NameDataset NameSOTA MethodSortMost resultsRecently updatedMost papersApplyTask NameDataset NameSOTA ResultTrendResultsLLM InferenceLong-Context LLM Inference Decode0.13Latency (ms)8LLM InferenceLong-Context LLM Inference (Prefill)0.62Prefill Latency (ms)6