# Parameter-Free Average Attention Improves Convolutional Neural Network Performance (Almost) Free of Charge

Source: [Parameter-Free Average Attention Improves Convolutional Neural Network Performance (Almost) Free of Charge](<https://www.sota2.com/research/paper/68fa6daa1e209131cea3b510>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T00:40:22.216Z

Authors: Nils K\\"orber

Published: 2022-10-14T13:56:43.000Z

## Abstract

Visual perception is driven by the focus on relevant aspects in the surrounding world. To transfer this observation to the digital information processing of computers, attention mechanisms have been introduced to highlight salient image regions. Here, we introduce a parameter-free attention mechanism called PfAAM, that is a simple yet effective module. It can be plugged into various convolutional neural network architectures with a little computational overhead and without affecting model size. PfAAM was tested on multiple architectures for classification and segmentic segmentation leading to improved model performance for all tested cases. This demonstrates its wide applicability as a general easy-to-use module for computer vision tasks. The implementation of PfAAM can be found on https://github.com/nkoerb/pfaam.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2210.07828>)

[PDF](<https://arxiv.org/pdf/2210.07828.pdf>)
