# Fair Classification on CelebA clean (test)

Source: [Fair Classification on CelebA clean (test)](<https://www.sota2.com/research/sota/fair-classification-on-celeba-clean-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-23T06:34:55.265Z

Evaluation of fairness-aware classification performance on the clean test split of the CelebA dataset, measured using specific fairness metrics like Acc s+ and Delta p s+.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Fair Classification |
| Dataset (including any stated split) | CelebA clean (test) |
| Metric | Accuracy s+ |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 8 of 8 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Accuracy s+](<https://www.sota2.com/research/sota/fair-classification-on-celeba-clean-test.md?metric=Accuracy%20s%2B>): Higher is better; unit: PERCENT.

- [Delta p s+](<https://www.sota2.com/research/sota/fair-classification-on-celeba-clean-test.md?metric=Delta%20p%20s%2B>): Lower is better; unit: SCALAR.

- [Accuracy s-](<https://www.sota2.com/research/sota/fair-classification-on-celeba-clean-test.md?metric=Accuracy%20s->): Higher is better; unit: PERCENT.

- [Delta p s-](<https://www.sota2.com/research/sota/fair-classification-on-celeba-clean-test.md?metric=Delta%20p%20s->): Lower is better; unit: SCALAR.

- [Accuracy](<https://www.sota2.com/research/sota/fair-classification-on-celeba-clean-test.md?metric=Accuracy>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Accuracy s+ | Result date | Report paper |
| --- | --- | --- | --- |
| MSAM | 98.01 | Not recorded | 68fa77be1e209131cea750f9 |
| SAM | 97.97 | Not recorded | 68fa77be1e209131cea750f9 |
| GroupSAM | 97.8 | Not recorded | 68fa77be1e209131cea750f9 |
| Vanilla | 97.69 | Not recorded | 68fa77be1e209131cea750f9 |
| FairSAM | 97.34 | Not recorded | 68fa77be1e209131cea750f9 |
| Reweighed | 96.27 | Not recorded | 68fa77be1e209131cea750f9 |
| GroupDRO | 95.73 | Not recorded | 68fa77be1e209131cea750f9 |
| FairReg | 94.42 | Not recorded | 68fa77be1e209131cea750f9 |

### MSAM

Accuracy s+: 98.01. Result ID: 6a3a2906fbc373592c33ce65.

[Reporting paper](<https://www.sota2.com/research/paper/68fa77be1e209131cea750f9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bc61e209131cea8a5c1.md>)

Recorded evaluation configuration: {"Test Data":"clean"}. This record does not assert independent reproduction.

### SAM

Accuracy s+: 97.97. Result ID: 6a3a2906fbc373592c33ce64.

[Reporting paper](<https://www.sota2.com/research/paper/68fa77be1e209131cea750f9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69d81e209131cea248fb.md>)

[Implementation](<https://github.com/google-research/sam>)

Recorded evaluation configuration: {"Test Data":"clean"}. This record does not assert independent reproduction.

### GroupSAM

Accuracy s+: 97.8. Result ID: 6a3a2906fbc373592c33ce66.

[Reporting paper](<https://www.sota2.com/research/paper/68fa77be1e209131cea750f9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa705b1e209131cea4a93e.md>)

Recorded evaluation configuration: {"Test Data":"clean"}. This record does not assert independent reproduction.

### Vanilla

Accuracy s+: 97.69. Result ID: 6a3a2906fbc373592c33ce60.

[Reporting paper](<https://www.sota2.com/research/paper/68fa77be1e209131cea750f9.md>)

Recorded evaluation configuration: {"Test Data":"clean"}. This record does not assert independent reproduction.

### FairSAM

Accuracy s+: 97.34. Result ID: 6a3a2906fbc373592c33ce67.

[Reporting paper](<https://www.sota2.com/research/paper/68fa77be1e209131cea750f9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77be1e209131cea750f9.md>)

Recorded evaluation configuration: {"Test Data":"clean"}. This record does not assert independent reproduction.

### Reweighed

Accuracy s+: 96.27. Result ID: 6a3a2906fbc373592c33ce62.

[Reporting paper](<https://www.sota2.com/research/paper/68fa77be1e209131cea750f9.md>)

Recorded evaluation configuration: {"Test Data":"clean"}. This record does not assert independent reproduction.

### GroupDRO

Accuracy s+: 95.73. Result ID: 6a3a2906fbc373592c33ce63.

[Reporting paper](<https://www.sota2.com/research/paper/68fa77be1e209131cea750f9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67561e209131cea159c7.md>)

Recorded evaluation configuration: {"Test Data":"clean"}. This record does not assert independent reproduction.

### FairReg

Accuracy s+: 94.42. Result ID: 6a3a2906fbc373592c33ce61.

[Reporting paper](<https://www.sota2.com/research/paper/68fa77be1e209131cea750f9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63371e209131ce9fd7c7.md>)

Recorded evaluation configuration: {"Test Data":"clean"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
