# Biography Classification on Bias-in-Bios

Source: [Biography Classification on Bias-in-Bios](<https://www.sota2.com/research/sota/biography-classification-on-bias-in-bios>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:47:53.926Z

Evaluation of model performance on the Biography Classification task using the Bias-in-Bios dataset, measured by Kendall's tau variations.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Biography Classification |
| Dataset (including any stated split) | Bias-in-Bios |
| Metric | Kendall's tau (Compression) |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 6 of 6 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Kendall's tau (Compression)](<https://www.sota2.com/research/sota/biography-classification-on-bias-in-bios.md?metric=Kendall%27s%20tau%20(Compression)>): Higher is better; unit: SCALAR.

- [Kendall's tau (TPR Gap)](<https://www.sota2.com/research/sota/biography-classification-on-bias-in-bios.md?metric=Kendall%27s%20tau%20(TPR%20Gap)>): Lower is better; unit: SCALAR.

- [Kendall's tau (Suff. Gap)](<https://www.sota2.com/research/sota/biography-classification-on-bias-in-bios.md?metric=Kendall%27s%20tau%20(Suff.%20Gap)>): Lower is better; unit: SCALAR.

## Recorded results

| Method | Kendall's tau (Compression) | Result date | Report paper |
| --- | --- | --- | --- |
| Mean MI | 0.6 | Not recorded | 68fa5b661e209131ce9c7f5b |
| Mean MI | 0.6 | Not recorded | 68fa5b661e209131ce9c7f5b |
| Mean Entropy | 0.47 | Not recorded | 68fa5b661e209131ce9c7f5b |
| Mean Entropy | 0.47 | Not recorded | 68fa5b661e209131ce9c7f5b |
| 2-Norm | 0.33 | Not recorded | 68fa5b661e209131ce9c7f5b |
| Frobenius-Norm | -0.2 | Not recorded | 68fa5b661e209131ce9c7f5b |

### Mean MI

Kendall's tau (Compression): 0.6. Result ID: 698bb1817a967eddb770a85a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5b661e209131ce9c7f5b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5b661e209131ce9c7f5b.md>)

[Implementation](<https://rachitbansal.github.io/information-measures>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Mean MI

Kendall's tau (Compression): 0.6. Result ID: 698c61ee37894ef7d9cdfcf7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5b661e209131ce9c7f5b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5b661e209131ce9c7f5b.md>)

[Implementation](<https://rachitbansal.github.io/information-measures>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Mean Entropy

Kendall's tau (Compression): 0.47. Result ID: 698bb1817a967eddb770a859.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5b661e209131ce9c7f5b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5b661e209131ce9c7f5b.md>)

[Implementation](<https://rachitbansal.github.io/information-measures>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Mean Entropy

Kendall's tau (Compression): 0.47. Result ID: 698c61ee37894ef7d9cdfcf6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5b661e209131ce9c7f5b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5b661e209131ce9c7f5b.md>)

[Implementation](<https://rachitbansal.github.io/information-measures>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### 2-Norm

Kendall's tau (Compression): 0.33. Result ID: 698c61ee37894ef7d9cdfcf8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5b661e209131ce9c7f5b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66cd1e209131cea126b2.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Frobenius-Norm

Kendall's tau (Compression): -0.2. Result ID: 698c61ee37894ef7d9cdfcf9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5b661e209131ce9c7f5b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66cd1e209131cea126b2.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.