ResearchTasksMulti-Head Attention Operator DevelopmentFollowBenchmarksDataset NameSOTA MethodSortMost resultsRecently updatedMost papersApplyDataset NameSOTA methodMetricTrendResultsLast UpdatedMHA (hd=64, sl=1024) on A100 GPULLM-TL175.6TFLOPS2Feb 26, 2026