# Disease Diagnosis on ChestX-ray14 (test)

Source: [Disease Diagnosis on ChestX-ray14 (test)](<https://www.sota2.com/research/sota/disease-diagnosis-on-chestx-ray14-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T06:09:01.978Z

Evaluation of disease diagnosis performance on the test split of the ChestX-ray14 dataset, focusing on worst-case AUC and AUC variability metrics.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Disease Diagnosis |
| Dataset (including any stated split) | ChestX-ray14 (test) |
| Metric | Worst-case AUC |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 14 of 14 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Worst-case AUC](<https://www.sota2.com/research/sota/disease-diagnosis-on-chestx-ray14-test.md?metric=Worst-case%20AUC>): Higher is better; unit: SCALAR.

- [AUC Gap](<https://www.sota2.com/research/sota/disease-diagnosis-on-chestx-ray14-test.md?metric=AUC%20Gap>): Lower is better; unit: SCALAR.

- [AUC SD](<https://www.sota2.com/research/sota/disease-diagnosis-on-chestx-ray14-test.md?metric=AUC%20SD>): Lower is better; unit: SCALAR.

## Recorded results

| Method | Worst-case AUC | Result date | Report paper |
| --- | --- | --- | --- |
| neutralized-CNN (Reported from Hu et al.) | 0.776 | Not recorded | 69730061b2be0ed85a78c842 |
| neutralized-CNN (Reported from Hu et al.) | 0.765 | Not recorded | 69730061b2be0ed85a78c842 |
| Original (baseline) | 0.76 | Not recorded | 69730061b2be0ed85a78c842 |
| Balanced sampling | 0.749 | Not recorded | 69730061b2be0ed85a78c842 |
| neutralized–ViT | 0.746 | Not recorded | 69730061b2be0ed85a78c842 |
| Balanced sampling | 0.737 | Not recorded | 69730061b2be0ed85a78c842 |
| Original (baseline) | 0.731 | Not recorded | 69730061b2be0ed85a78c842 |
| Manifold-Mixup | 0.711 | Not recorded | 69730061b2be0ed85a78c842 |
| neutralized–ViT | 0.698 | Not recorded | 69730061b2be0ed85a78c842 |
| Manifold-Mixup | 0.638 | Not recorded | 69730061b2be0ed85a78c842 |
| Mixup | 0.628 | Not recorded | 69730061b2be0ed85a78c842 |
| Mixup | 0.609 | Not recorded | 69730061b2be0ed85a78c842 |
| neutralized–CNN | 0.49 | Not recorded | 69730061b2be0ed85a78c842 |
| neutralized–CNN | 0.486 | Not recorded | 69730061b2be0ed85a78c842 |

### neutralized-CNN (Reported from Hu et al.)

Worst-case AUC: 0.776. Result ID: 69979c3c5698665ec4f21629.

[Reporting paper](<https://www.sota2.com/research/paper/69730061b2be0ed85a78c842.md>)

Recorded evaluation configuration: {"Attribute":"Sex"}. This record does not assert independent reproduction.

### neutralized-CNN (Reported from Hu et al.)

Worst-case AUC: 0.765. Result ID: 69979c3c5698665ec4f21628.

[Reporting paper](<https://www.sota2.com/research/paper/69730061b2be0ed85a78c842.md>)

Recorded evaluation configuration: {"Attribute":"Age"}. This record does not assert independent reproduction.

### Original (baseline)

Worst-case AUC: 0.76. Result ID: 69979c3c5698665ec4f2161d.

[Reporting paper](<https://www.sota2.com/research/paper/69730061b2be0ed85a78c842.md>)

Recorded evaluation configuration: {"Attribute":"Sex"}. This record does not assert independent reproduction.

### Balanced sampling

Worst-case AUC: 0.749. Result ID: 69979c3c5698665ec4f2161f.

[Reporting paper](<https://www.sota2.com/research/paper/69730061b2be0ed85a78c842.md>)

Recorded evaluation configuration: {"Attribute":"Sex"}. This record does not assert independent reproduction.

### neutralized–ViT

Worst-case AUC: 0.746. Result ID: 69979c3c5698665ec4f21621.

[Reporting paper](<https://www.sota2.com/research/paper/69730061b2be0ed85a78c842.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69730061b2be0ed85a78c842.md>)

Recorded evaluation configuration: {"Attribute":"Sex"}. This record does not assert independent reproduction.

### Balanced sampling

Worst-case AUC: 0.737. Result ID: 69979c3c5698665ec4f2161e.

[Reporting paper](<https://www.sota2.com/research/paper/69730061b2be0ed85a78c842.md>)

Recorded evaluation configuration: {"Attribute":"Age"}. This record does not assert independent reproduction.

### Original (baseline)

Worst-case AUC: 0.731. Result ID: 69979c3c5698665ec4f2161c.

[Reporting paper](<https://www.sota2.com/research/paper/69730061b2be0ed85a78c842.md>)

Recorded evaluation configuration: {"Attribute":"Age"}. This record does not assert independent reproduction.

### Manifold-Mixup

Worst-case AUC: 0.711. Result ID: 69979c3c5698665ec4f21625.

[Reporting paper](<https://www.sota2.com/research/paper/69730061b2be0ed85a78c842.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa697f1e209131cea227c2.md>)

Recorded evaluation configuration: {"Attribute":"Sex"}. This record does not assert independent reproduction.

### neutralized–ViT

Worst-case AUC: 0.698. Result ID: 69979c3c5698665ec4f21620.

[Reporting paper](<https://www.sota2.com/research/paper/69730061b2be0ed85a78c842.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69730061b2be0ed85a78c842.md>)

Recorded evaluation configuration: {"Attribute":"Age"}. This record does not assert independent reproduction.

### Manifold-Mixup

Worst-case AUC: 0.638. Result ID: 69979c3c5698665ec4f21624.

[Reporting paper](<https://www.sota2.com/research/paper/69730061b2be0ed85a78c842.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa697f1e209131cea227c2.md>)

Recorded evaluation configuration: {"Attribute":"Age"}. This record does not assert independent reproduction.

### Mixup

Worst-case AUC: 0.628. Result ID: 69979c3c5698665ec4f21623.

[Reporting paper](<https://www.sota2.com/research/paper/69730061b2be0ed85a78c842.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa697f1e209131cea227c2.md>)

Recorded evaluation configuration: {"Attribute":"Sex"}. This record does not assert independent reproduction.

### Mixup

Worst-case AUC: 0.609. Result ID: 69979c3c5698665ec4f21622.

[Reporting paper](<https://www.sota2.com/research/paper/69730061b2be0ed85a78c842.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa697f1e209131cea227c2.md>)

Recorded evaluation configuration: {"Attribute":"Age"}. This record does not assert independent reproduction.

### neutralized–CNN

Worst-case AUC: 0.49. Result ID: 69979c3c5698665ec4f21626.

[Reporting paper](<https://www.sota2.com/research/paper/69730061b2be0ed85a78c842.md>)

Recorded evaluation configuration: {"Attribute":"Age"}. This record does not assert independent reproduction.

### neutralized–CNN

Worst-case AUC: 0.486. Result ID: 69979c3c5698665ec4f21627.

[Reporting paper](<https://www.sota2.com/research/paper/69730061b2be0ed85a78c842.md>)

Recorded evaluation configuration: {"Attribute":"Sex"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
