ResearchDatasetsLong-Context LLM InferenceLong-Context LLM InferenceFollowBenchmarksTaskDatasetSOTA methodSortMost resultsRecently updatedMost papersApplyTaskDatasetSOTA resultTrendResultsLLM InferenceLong-Context LLM Inference Decode0.13Latency (ms)8LLM InferenceLong-Context LLM Inference (Prefill)0.62Prefill Latency (ms)6