ResearchTasksRelative Pos. AttentionRelative Pos. AttentionFollowBenchmarksDatasetSOTA methodSortMost resultsRecently updatedMost papersApplyDatasetSOTA methodMetricTrendResultsLast updatedLlama2-7b (q=32, k=32) (1k)FlexAttention114.85TFLOPS (Relative Pos. Attention)4May 7, 2026