ResearchDatasetsSequence BucketFollowBenchmarksTask NameDataset NameSOTA MethodSortMost resultsRecently updatedMost papersApplyTask NameDataset NameSOTA ResultTrendResultsLanguage Model InferenceSequence Bucket Ultra-long77.97Latency (ms)3Language Model InferenceSequence Bucket Long69.58Latency (ms)3Language Model InferenceSequence Bucket Medium52.88Latency (ms)3Language Model InferenceSequence Bucket Short39.26Latency (ms)3