# Investigating a Baseline Of Self Supervised Learning Towards Reducing Labeling Costs For Image Classification

Source: [Investigating a Baseline Of Self Supervised Learning Towards Reducing Labeling Costs For Image Classification](<https://www.sota2.com/research/paper/68fa6a8d1e209131cea28bc0>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T23:27:27.413Z

Authors: Hilal AlQuabeh, Ameera Bawazeer, Abdulateef Alhashmi

Published: 2021-08-17T06:43:05.000Z

## Abstract

Data labeling in supervised learning is considered an expensive and infeasible tool in some conditions. The self-supervised learning method is proposed to tackle the learning effectiveness with fewer labeled data, however, there is a lack of confidence in the size of labeled data needed to achieve adequate results. This study aims to draw a baseline on the proportion of the labeled data that models can appreciate to yield competent accuracy when compared to training with additional labels. The study implements the kaggle.com' cats-vs-dogs dataset, Mnist and Fashion-Mnist to investigate the self-supervised learning task by implementing random rotations augmentation on the original datasets. To reveal the true effectiveness of the pretext process in self-supervised learning, the original dataset is divided into smaller batches, and learning is repeated on each batch with and without the pretext pre-training. Results show that the pretext process in the self-supervised learning improves the accuracy around 15% in the downstream classification task when compared to the plain supervised learning.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2108.07464>)

[PDF](<https://arxiv.org/pdf/2108.07464.pdf>)
