ResearchTasksIdentification of inactive attention headsIdentification of inactive attention headsFollowBenchmarksDatasetSOTA methodSortMost resultsRecently updatedMost papersApplyDatasetSOTA methodMetricTrendResultsLast updatedWinoGrandeLast Token Head Output Norm (LN)20.91Percentage of Zeroed Heads30Mar 4, 2026