Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Identification of inactive attention heads research benchmarks · SOTA2 Research

Identification of inactive attention heads

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

Last Token Head Output Norm (LN)

20.91Percentage of Zeroed Heads

30

Mar 4, 2026

Popular datasets

Follow for updates

Join SOTA2 Contact