# Advancing Supervised Local Learning Beyond Classification with Long-term Feature Bank

Source: [Advancing Supervised Local Learning Beyond Classification with Long-term Feature Bank](<https://www.sota2.com/research/paper/68fa7a681e209131cea82ff0>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T05:20:02.433Z

Authors: Feiyu Zhu, Yuming Zhang, Xiuyuan Guo, Hengyu Shi, Junfeng Luo, Junhao Su, Jialin Gao

Published: 2024-06-01T14:02:11.000Z

## Abstract

Local learning offers an alternative to traditional end-to-end back-propagation in deep neural networks, significantly reducing GPU memory consumption. Although it has shown promise in image classification tasks, its extension to other visual tasks has been limited. This limitation arises primarily from two factors: 1) architectures designed specifically for classification are not readily adaptable to other tasks, which prevents the effective reuse of task-specific knowledge from architectures tailored to different problems; 2) these classification-focused architectures typically lack cross-scale feature communication, leading to degraded performance in tasks like object detection and super-resolution. To address these challenges, we propose the Feature Bank Augmented auxiliary network (FBA), which introduces a simplified design principle and incorporates a feature bank to enhance cross-task adaptability and communication. This work represents the first successful application of local learning methods beyond classification, demonstrating that FBA not only conserves GPU memory but also achieves performance on par with end-to-end approaches across multiple datasets for various visual tasks.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2406.00446>)

[PDF](<https://arxiv.org/pdf/2406.00446.pdf>)
