# Classification on LUNA16

Source: [Classification on LUNA16](<https://www.sota2.com/research/sota/classification-on-luna16>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:24:18.757Z

Evaluation of general Classification performance on the LUNA16 dataset.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Classification |
| Dataset (including any stated split) | LUNA16 |
| Metric | AUC |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 16 of 16 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [AUC](<https://www.sota2.com/research/sota/classification-on-luna16.md?metric=AUC>): Higher is better; unit: SCALAR.

## Recorded results

| Method | AUC | Result date | Report paper |
| --- | --- | --- | --- |
| SimCroP | 0.733 | Not recorded | 68fa7b471e209131cea877b6 |
| MRM | 0.722 | Not recorded | 68fa7b471e209131cea877b6 |
| fVLM | 0.713 | Not recorded | 68fa7b471e209131cea877b6 |
| M3AE | 0.708 | Not recorded | 68fa7b471e209131cea877b6 |
| MAE | 0.705 | Not recorded | 68fa7b471e209131cea877b6 |
| M3D | 0.684 | Not recorded | 68fa7b471e209131cea877b6 |
| M3AE | 0.671 | Not recorded | 68fa7b471e209131cea877b6 |
| SimCroP | 0.67 | Not recorded | 68fa7b471e209131cea877b6 |
| MRM | 0.666 | Not recorded | 68fa7b471e209131cea877b6 |
| MAE | 0.663 | Not recorded | 68fa7b471e209131cea877b6 |
| fVLM | 0.659 | Not recorded | 68fa7b471e209131cea877b6 |
| M3D | 0.652 | Not recorded | 68fa7b471e209131cea877b6 |
| CT-CLIP | 0.65 | Not recorded | 68fa7b471e209131cea877b6 |
| CT-CLIP | 0.64 | Not recorded | 68fa7b471e209131cea877b6 |
| Random init | 0.604 | Not recorded | 68fa7b471e209131cea877b6 |
| Random init | 0.576 | Not recorded | 68fa7b471e209131cea877b6 |

### SimCroP

AUC: 0.733. Result ID: 698b841e7a967eddb76f3cac.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7b471e209131cea877b6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b471e209131cea877b6.md>)

[Implementation](<https://github.com/ToniChopp/SimCroP>)

Recorded evaluation configuration: {"Backbone":"3D ViT-B","Evaluation Protocol":"Linear probing","Label Percentage":"100%"}. This record does not assert independent reproduction.

### MRM

AUC: 0.722. Result ID: 698b841e7a967eddb76f3ca6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7b471e209131cea877b6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e8b1e209131cea40752.md>)

Recorded evaluation configuration: {"Backbone":"3D ViT-B","Evaluation Protocol":"Linear probing","Label Percentage":"100%"}. This record does not assert independent reproduction.

### fVLM

AUC: 0.713. Result ID: 698b841e7a967eddb76f3caa.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7b471e209131cea877b6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76b71e209131cea6eaf0.md>)

Recorded evaluation configuration: {"Backbone":"3D ViT-B","Evaluation Protocol":"Linear probing","Label Percentage":"100%"}. This record does not assert independent reproduction.

### M3AE

AUC: 0.708. Result ID: 698b841e7a967eddb76f3ca2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7b471e209131cea877b6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6d681e209131cea399ac.md>)

[Implementation](<https://github.com/zhjohnchan/M3AE>)

Recorded evaluation configuration: {"Backbone":"3D ViT-B","Evaluation Protocol":"Linear probing","Label Percentage":"100%"}. This record does not assert independent reproduction.

### MAE

AUC: 0.705. Result ID: 698b841e7a967eddb76f3ca0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7b471e209131cea877b6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b7f1e209131cea2e973.md>)

Recorded evaluation configuration: {"Backbone":"3D ViT-B","Evaluation Protocol":"Linear probing","Label Percentage":"100%"}. This record does not assert independent reproduction.

### M3D

AUC: 0.684. Result ID: 698b841e7a967eddb76f3ca8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7b471e209131cea877b6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72be1e209131cea58507.md>)

Recorded evaluation configuration: {"Backbone":"3D ViT-B","Evaluation Protocol":"Linear probing","Label Percentage":"100%"}. This record does not assert independent reproduction.

### M3AE

AUC: 0.671. Result ID: 698b841e7a967eddb76f3ca1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7b471e209131cea877b6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6d681e209131cea399ac.md>)

[Implementation](<https://github.com/zhjohnchan/M3AE>)

Recorded evaluation configuration: {"Backbone":"3D ViT-B","Evaluation Protocol":"Linear probing","Label Percentage":"10%"}. This record does not assert independent reproduction.

### SimCroP

AUC: 0.67. Result ID: 698b841e7a967eddb76f3cab.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7b471e209131cea877b6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b471e209131cea877b6.md>)

[Implementation](<https://github.com/ToniChopp/SimCroP>)

Recorded evaluation configuration: {"Backbone":"3D ViT-B","Evaluation Protocol":"Linear probing","Label Percentage":"10%"}. This record does not assert independent reproduction.

### MRM

AUC: 0.666. Result ID: 698b841e7a967eddb76f3ca5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7b471e209131cea877b6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e8b1e209131cea40752.md>)

Recorded evaluation configuration: {"Backbone":"3D ViT-B","Evaluation Protocol":"Linear probing","Label Percentage":"10%"}. This record does not assert independent reproduction.

### MAE

AUC: 0.663. Result ID: 698b841e7a967eddb76f3c9f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7b471e209131cea877b6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b7f1e209131cea2e973.md>)

Recorded evaluation configuration: {"Backbone":"3D ViT-B","Evaluation Protocol":"Linear probing","Label Percentage":"10%"}. This record does not assert independent reproduction.

### fVLM

AUC: 0.659. Result ID: 698b841e7a967eddb76f3ca9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7b471e209131cea877b6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76b71e209131cea6eaf0.md>)

Recorded evaluation configuration: {"Backbone":"3D ViT-B","Evaluation Protocol":"Linear probing","Label Percentage":"10%"}. This record does not assert independent reproduction.

### M3D

AUC: 0.652. Result ID: 698b841e7a967eddb76f3ca7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7b471e209131cea877b6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72be1e209131cea58507.md>)

Recorded evaluation configuration: {"Backbone":"3D ViT-B","Evaluation Protocol":"Linear probing","Label Percentage":"10%"}. This record does not assert independent reproduction.

### CT-CLIP

AUC: 0.65. Result ID: 698b841e7a967eddb76f3ca4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7b471e209131cea877b6.md>)

Recorded evaluation configuration: {"Backbone":"3D ViT-B","Evaluation Protocol":"Linear probing","Label Percentage":"100%"}. This record does not assert independent reproduction.

### CT-CLIP

AUC: 0.64. Result ID: 698b841e7a967eddb76f3ca3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7b471e209131cea877b6.md>)

Recorded evaluation configuration: {"Backbone":"3D ViT-B","Evaluation Protocol":"Linear probing","Label Percentage":"10%"}. This record does not assert independent reproduction.

### Random init

AUC: 0.604. Result ID: 698b841e7a967eddb76f3c9e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7b471e209131cea877b6.md>)

Recorded evaluation configuration: {"Backbone":"3D ViT-B","Evaluation Protocol":"Linear probing","Label Percentage":"100%"}. This record does not assert independent reproduction.

### Random init

AUC: 0.576. Result ID: 698b841e7a967eddb76f3c9d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7b471e209131cea877b6.md>)

Recorded evaluation configuration: {"Backbone":"3D ViT-B","Evaluation Protocol":"Linear probing","Label Percentage":"10%"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
