# Comparative Analysis of ImageNet Pre-Trained Deep Learning Models and DINOv2 in Medical Imaging Classification

Source: [Comparative Analysis of ImageNet Pre-Trained Deep Learning Models and DINOv2 in Medical Imaging Classification](<https://www.sota2.com/research/paper/68fa723b1e209131cea55242>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T02:21:13.235Z

Authors: Yuning Huang, Jingchen Zou, Lanxi Meng, Xin Yue, Qing Zhao, Jianqiang Li, Changwei Song, Gabriel Jimenez, Shaowu Li, Guanghui Fu

Published: 2024-02-12T11:49:08.000Z

## Abstract

Medical image analysis frequently encounters data scarcity challenges. Transfer learning has been effective in addressing this issue while conserving computational resources. The recent advent of foundational models like the DINOv2, which uses the vision transformer architecture, has opened new opportunities in the field and gathered significant interest. However, DINOv2's performance on clinical data still needs to be verified. In this paper, we performed a glioma grading task using three clinical modalities of brain MRI data. We compared the performance of various pre-trained deep learning models, including those based on ImageNet and DINOv2, in a transfer learning context. Our focus was on understanding the impact of the freezing mechanism on performance. We also validated our findings on three other types of public datasets: chest radiography, fundus radiography, and dermoscopy. Our findings indicate that in our clinical dataset, DINOv2's performance was not as strong as ImageNet-based pre-trained models, whereas in public datasets, DINOv2 generally outperformed other models, especially when using the frozen mechanism. Similar performance was observed with various sizes of DINOv2 models across different tasks. In summary, DINOv2 is viable for medical image classification tasks, particularly with data resembling natural images. However, its effectiveness may vary with data that significantly differs from natural images such as MRI. In addition, employing smaller versions of the model can be adequate for medical task, offering resource-saving benefits. Our codes are available at https://github.com/GuanghuiFU/medical\_DINOv2\_eval.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Glioma Subtype Classification on Glioma Subtype Classification (Internal)](<https://www.sota2.com/research/sota/glioma-subtype-classification-on-glioma-subtype-classification-internal.md>): Glioma Subtype Classification; Glioma Subtype Classification (Internal); MCC: 0.55.

- [Glioma Subtype Classification on Glioma Subtype Classification (External)](<https://www.sota2.com/research/sota/glioma-subtype-classification-on-glioma-subtype-classification-external.md>): Glioma Subtype Classification; Glioma Subtype Classification (External); MCC: 0.52.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2402.07595>)

[PDF](<https://arxiv.org/pdf/2402.07595.pdf>)
