ResearchTasksRelative Pos. AttentionFollowBenchmarksDataset NameSOTA MethodSortMost resultsRecently updatedMost papersApplyDataset NameSOTA methodMetricTrendResultsLast UpdatedLlama2-7b (q=32, k=32) (1k)FlexAttention114.85TFLOPS (Relative Pos. Attention)4May 7, 2026