# A Computational Account Of Self-Supervised Visual Learning From Egocentric Object Play

Source: [A Computational Account Of Self-Supervised Visual Learning From Egocentric Object Play](<https://www.sota2.com/research/paper/68fa6f981e209131cea46826>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T01:23:24.960Z

Authors: Deepayan Sanyal, Joel Michelson, Yuan Yang, James Ainooson, Maithilee Kunda

Published: 2023-05-30T22:42:03.000Z

## Abstract

Research in child development has shown that embodied experience handling physical objects contributes to many cognitive abilities, including visual learning. One characteristic of such experience is that the learner sees the same object from several different viewpoints. In this paper, we study how learning signals that equate different viewpoints -- e.g., assigning similar representations to different views of a single object -- can support robust visual learning. We use the Toybox dataset, which contains egocentric videos of humans manipulating different objects, and conduct experiments using a computer vision framework for self-supervised contrastive learning. We find that representations learned by equating different physical viewpoints of an object benefit downstream image classification accuracy. Further experiments show that this performance improvement is robust to variations in the gaps between viewpoints, and that the benefits transfer to several different image classification tasks.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2305.19445>)

[PDF](<https://arxiv.org/pdf/2305.19445.pdf>)