# Can Local Learning Match Self-Supervised Backpropagation?

Source: [Can Local Learning Match Self-Supervised Backpropagation?](<https://www.sota2.com/research/paper/697c3b5ba8b01e76cc8da657>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-04T05:01:01.134Z

Authors: Wu S. Zihan, Ariane Delrocq, Wulfram Gerstner, Guillaume Bellec

Published: 2026-01-29T13:15:57.000Z

## Abstract

While end-to-end self-supervised learning with backpropagation (global BP-SSL) has become central for training modern AI systems, theories of local self-supervised learning (local-SSL) have struggled to build functional representations in deep neural networks. To establish a link between global and local rules, we first develop a theory for deep linear networks: we identify conditions for local-SSL algorithms (like Forward-forward or CLAPP) to implement exactly the same weight update as a global BP-SSL. Starting from the theoretical insights, we then develop novel variants of local-SSL algorithms to approximate global BP-SSL in deep non-linear convolutional neural networks. Variants that improve the similarity between gradient updates of local-SSL with those of global BP-SSL also show better performance on image datasets (CIFAR-10, STL-10, and Tiny ImageNet). The best local-SSL rule with the CLAPP loss function matches the performance of a comparable global BP-SSL with InfoNCE or CPC-like loss functions, and improves upon state-of-the-art for local SSL on these benchmarks.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Image Classification on STL-10 (test)](<https://www.sota2.com/research/sota/image-classification-on-stl-10-test.md>): Image Classification; STL-10 (test); Accuracy: 79.62.

- [Image Classification on Tiny-ImageNet (test)](<https://www.sota2.com/research/sota/image-classification-on-tiny-imagenet-test.md>): Image Classification; Tiny ImageNet (test); Accuracy: 37.78.

- [Image Classification on CIFAR10 (test) (Accuracy)](<https://www.sota2.com/research/sota/image-classification-on-cifar10-test-accuracy.md>): Image Classification; CIFAR10 (test); Accuracy: 81.18.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2601.21683>)

[PDF](<https://arxiv.org/pdf/2601.21683.pdf>)
