# Fairness Classification (Big Nose label) on CelebA (test)

Source: [Fairness Classification (Big Nose label) on CelebA (test)](<https://www.sota2.com/research/sota/fairness-classification-big-nose-label-on-celeba-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T06:11:13.999Z

Evaluation of fairness classification performance on the test split of the CelebA dataset, focusing on the 'Big Nose' label, measured using fairness metrics such as pAUC, EOD, EOP, and DP.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Fairness classification (Big Nose label) |
| Dataset (including any stated split) | CelebA (test) |
| Metric | pAUC |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 5 of 5 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [pAUC](<https://www.sota2.com/research/sota/fairness-classification-big-nose-label-on-celeba-test.md?metric=pAUC>): Higher is better; unit: SCALAR.

- [EOD (Equality of Opportunity Difference)](<https://www.sota2.com/research/sota/fairness-classification-big-nose-label-on-celeba-test.md?metric=EOD%20(Equality%20of%20Opportunity%20Difference)>): Lower is better; unit: SCALAR.

- [EOP (Equality of Odds Difference)](<https://www.sota2.com/research/sota/fairness-classification-big-nose-label-on-celeba-test.md?metric=EOP%20(Equality%20of%20Odds%20Difference)>): Lower is better; unit: SCALAR.

- [DP (Demographic Parity Difference)](<https://www.sota2.com/research/sota/fairness-classification-big-nose-label-on-celeba-test.md?metric=DP%20(Demographic%20Parity%20Difference)>): Lower is better; unit: SCALAR.

## Recorded results

| Method | pAUC | Result date | Report paper |
| --- | --- | --- | --- |
| SMAG\* | 0.8078 | Not recorded | 68fa5c9a1e209131ce9d282d |
| SMAG | 0.8058 | Not recorded | 68fa5c9a1e209131ce9d282d |
| SOPA | 0.8039 | Not recorded | 68fa5c9a1e209131ce9d282d |
| SGDA | 0.8038 | Not recorded | 68fa5c9a1e209131ce9d282d |
| EGDA | 0.8023 | Not recorded | 68fa5c9a1e209131ce9d282d |

### SMAG\*

pAUC: 0.8078. Result ID: 698bb6ef7a967eddb770cf48.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5c9a1e209131ce9d282d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5c9a1e209131ce9d282d.md>)

Recorded evaluation configuration: {"Sensitive Attribute":"Male"}. This record does not assert independent reproduction.

### SMAG

pAUC: 0.8058. Result ID: 698bb6ef7a967eddb770cf4b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5c9a1e209131ce9d282d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5c9a1e209131ce9d282d.md>)

Recorded evaluation configuration: {"Sensitive Attribute":"Male"}. This record does not assert independent reproduction.

### SOPA

pAUC: 0.8039. Result ID: 698bb6ef7a967eddb770cf47.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5c9a1e209131ce9d282d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5ade1e209131ce9c3584.md>)

Recorded evaluation configuration: {"Sensitive Attribute":"Male"}. This record does not assert independent reproduction.

### SGDA

pAUC: 0.8038. Result ID: 698bb6ef7a967eddb770cf49.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5c9a1e209131ce9d282d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5bc01e209131ce9cb3d5.md>)

Recorded evaluation configuration: {"Sensitive Attribute":"Male"}. This record does not assert independent reproduction.

### EGDA

pAUC: 0.8023. Result ID: 698bb6ef7a967eddb770cf4a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5c9a1e209131ce9d282d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa57081e209131ce9a207a.md>)

Recorded evaluation configuration: {"Sensitive Attribute":"Male"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.