# Social Debiasing on FACET Out-of-Domain

Source: [Social Debiasing on FACET Out-of-Domain](<https://www.sota2.com/research/sota/social-debiasing-on-facet-out-of-domain>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:50:33.646Z

Evaluation of social debiasing techniques applied to the Out-of-Domain subset of the FACET dataset, measured using fairness metrics like MS and NDKL.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Social Debiasing |
| Dataset (including any stated split) | FACET Out-of-Domain |
| Metric | MS |
| Unit | SCALAR |
| Direction | Lower is better |
| Results loaded | 32 of 32 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [MS](<https://www.sota2.com/research/sota/social-debiasing-on-facet-out-of-domain.md?metric=MS>): Lower is better; unit: SCALAR.

- [NDKL](<https://www.sota2.com/research/sota/social-debiasing-on-facet-out-of-domain.md?metric=NDKL>): Lower is better; unit: SCALAR.

## Recorded results

| Method | MS | Result date | Report paper |
| --- | --- | --- | --- |
| Biased-prompts | 0.417 | Not recorded | 68fa75c01e209131cea69b51 |
| CLIP-clip | 0.45 | Not recorded | 68fa75c01e209131cea69b51 |
| Ours | 0.455 | Not recorded | 68fa75c01e209131cea69b51 |
| Ours | 0.456 | Not recorded | 68fa75c01e209131cea69b51 |
| Biased-prompts | 0.456 | Not recorded | 68fa75c01e209131cea69b51 |
| CLIP-clip | 0.459 | Not recorded | 68fa75c01e209131cea69b51 |
| Biased-prompts | 0.46 | Not recorded | 68fa75c01e209131cea69b51 |
| CLIP-clip | 0.465 | Not recorded | 68fa75c01e209131cea69b51 |
| Ours | 0.469 | Not recorded | 68fa75c01e209131cea69b51 |
| Biased-prompts | 0.477 | Not recorded | 68fa75c01e209131cea69b51 |
| Original CLIP | 0.478 | Not recorded | 68fa75c01e209131cea69b51 |
| Original CLIP | 0.483 | Not recorded | 68fa75c01e209131cea69b51 |
| Ours | 0.484 | Not recorded | 68fa75c01e209131cea69b51 |
| Original CLIP | 0.485 | Not recorded | 68fa75c01e209131cea69b51 |
| Original CLIP | 0.487 | Not recorded | 68fa75c01e209131cea69b51 |
| CLIP-clip | 0.5 | Not recorded | 68fa75c01e209131cea69b51 |
| Biased-prompts | 0.635 | Not recorded | 68fa75c01e209131cea69b51 |
| Biased-prompts | 0.663 | Not recorded | 68fa75c01e209131cea69b51 |
| Biased-prompts | 0.727 | Not recorded | 68fa75c01e209131cea69b51 |
| Original CLIP | 0.744 | Not recorded | 68fa75c01e209131cea69b51 |
| CLIP-clip | 0.745 | Not recorded | 68fa75c01e209131cea69b51 |
| Ours | 0.746 | Not recorded | 68fa75c01e209131cea69b51 |
| Original CLIP | 0.749 | Not recorded | 68fa75c01e209131cea69b51 |
| Ours | 0.751 | Not recorded | 68fa75c01e209131cea69b51 |
| Original CLIP | 0.752 | Not recorded | 68fa75c01e209131cea69b51 |
| CLIP-clip | 0.753 | Not recorded | 68fa75c01e209131cea69b51 |
| CLIP-clip | 0.754 | Not recorded | 68fa75c01e209131cea69b51 |
| Ours | 0.754 | Not recorded | 68fa75c01e209131cea69b51 |
| Original CLIP | 0.764 | Not recorded | 68fa75c01e209131cea69b51 |
| Ours | 0.766 | Not recorded | 68fa75c01e209131cea69b51 |
| CLIP-clip | 0.769 | Not recorded | 68fa75c01e209131cea69b51 |
| Biased-prompts | 0.79 | Not recorded | 68fa75c01e209131cea69b51 |

### Biased-prompts

MS: 0.417. Result ID: 6993f9743a6c3148491a0108.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75c01e209131cea69b51.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f531e209131cea4511d.md>)

Recorded evaluation configuration: {"Backbone":"ViT-B/32","Biases":"Gender"}. This record does not assert independent reproduction.

### CLIP-clip

MS: 0.45. Result ID: 6993f9743a6c3148491a0117.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75c01e209131cea69b51.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ab41e209131cea29e50.md>)

Recorded evaluation configuration: {"Backbone":"ViT-H/14","Biases":"Gender"}. This record does not assert independent reproduction.

### Ours

MS: 0.455. Result ID: 6993f9743a6c3148491a0119.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75c01e209131cea69b51.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75c01e209131cea69b51.md>)

Recorded evaluation configuration: {"Backbone":"ViT-H/14","Biases":"Gender"}. This record does not assert independent reproduction.

### Ours

MS: 0.456. Result ID: 6993f9743a6c3148491a0101.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75c01e209131cea69b51.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75c01e209131cea69b51.md>)

Recorded evaluation configuration: {"Backbone":"ViT-B/16","Biases":"Gender"}. This record does not assert independent reproduction.

### Biased-prompts

MS: 0.456. Result ID: 6993f9743a6c3148491a0118.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75c01e209131cea69b51.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f531e209131cea4511d.md>)

Recorded evaluation configuration: {"Backbone":"ViT-H/14","Biases":"Gender"}. This record does not assert independent reproduction.

### CLIP-clip

MS: 0.459. Result ID: 6993f9743a6c3148491a00ff.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75c01e209131cea69b51.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ab41e209131cea29e50.md>)

Recorded evaluation configuration: {"Backbone":"ViT-B/16","Biases":"Gender"}. This record does not assert independent reproduction.

### Biased-prompts

MS: 0.46. Result ID: 6993f9743a6c3148491a0100.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75c01e209131cea69b51.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f531e209131cea4511d.md>)

Recorded evaluation configuration: {"Backbone":"ViT-B/16","Biases":"Gender"}. This record does not assert independent reproduction.

### CLIP-clip

MS: 0.465. Result ID: 6993f9743a6c3148491a010f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75c01e209131cea69b51.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ab41e209131cea29e50.md>)

Recorded evaluation configuration: {"Backbone":"ViT-L/14","Biases":"Gender"}. This record does not assert independent reproduction.

### Ours

MS: 0.469. Result ID: 6993f9743a6c3148491a0109.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75c01e209131cea69b51.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75c01e209131cea69b51.md>)

Recorded evaluation configuration: {"Backbone":"ViT-B/32","Biases":"Gender"}. This record does not assert independent reproduction.

### Biased-prompts

MS: 0.477. Result ID: 6993f9743a6c3148491a0110.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75c01e209131cea69b51.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f531e209131cea4511d.md>)

Recorded evaluation configuration: {"Backbone":"ViT-L/14","Biases":"Gender"}. This record does not assert independent reproduction.

### Original CLIP

MS: 0.478. Result ID: 6993f9743a6c3148491a00fe.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75c01e209131cea69b51.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69581e209131cea21ad0.md>)

[Implementation](<https://github.com/OpenAI/CLIP>)

Recorded evaluation configuration: {"Backbone":"ViT-B/16","Biases":"Gender"}. This record does not assert independent reproduction.

### Original CLIP

MS: 0.483. Result ID: 6993f9743a6c3148491a0116.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75c01e209131cea69b51.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69581e209131cea21ad0.md>)

[Implementation](<https://github.com/OpenAI/CLIP>)

Recorded evaluation configuration: {"Backbone":"ViT-H/14","Biases":"Gender"}. This record does not assert independent reproduction.

### Ours

MS: 0.484. Result ID: 6993f9743a6c3148491a0111.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75c01e209131cea69b51.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75c01e209131cea69b51.md>)

Recorded evaluation configuration: {"Backbone":"ViT-L/14","Biases":"Gender"}. This record does not assert independent reproduction.

### Original CLIP

MS: 0.485. Result ID: 6993f9743a6c3148491a0106.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75c01e209131cea69b51.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69581e209131cea21ad0.md>)

[Implementation](<https://github.com/OpenAI/CLIP>)

Recorded evaluation configuration: {"Backbone":"ViT-B/32","Biases":"Gender"}. This record does not assert independent reproduction.

### Original CLIP

MS: 0.487. Result ID: 6993f9743a6c3148491a010e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75c01e209131cea69b51.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69581e209131cea21ad0.md>)

[Implementation](<https://github.com/OpenAI/CLIP>)

Recorded evaluation configuration: {"Backbone":"ViT-L/14","Biases":"Gender"}. This record does not assert independent reproduction.

### CLIP-clip

MS: 0.5. Result ID: 6993f9743a6c3148491a0107.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75c01e209131cea69b51.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ab41e209131cea29e50.md>)

Recorded evaluation configuration: {"Backbone":"ViT-B/32","Biases":"Gender"}. This record does not assert independent reproduction.

### Biased-prompts

MS: 0.635. Result ID: 6993f9743a6c3148491a0104.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75c01e209131cea69b51.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f531e209131cea4511d.md>)

Recorded evaluation configuration: {"Backbone":"ViT-B/16","Biases":"Age"}. This record does not assert independent reproduction.

### Biased-prompts

MS: 0.663. Result ID: 6993f9743a6c3148491a010c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75c01e209131cea69b51.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f531e209131cea4511d.md>)

Recorded evaluation configuration: {"Backbone":"ViT-B/32","Biases":"Age"}. This record does not assert independent reproduction.

### Biased-prompts

MS: 0.727. Result ID: 6993f9743a6c3148491a0114.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75c01e209131cea69b51.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f531e209131cea4511d.md>)

Recorded evaluation configuration: {"Backbone":"ViT-L/14","Biases":"Age"}. This record does not assert independent reproduction.

### Original CLIP

MS: 0.744. Result ID: 6993f9743a6c3148491a0102.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75c01e209131cea69b51.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69581e209131cea21ad0.md>)

[Implementation](<https://github.com/OpenAI/CLIP>)

Recorded evaluation configuration: {"Backbone":"ViT-B/16","Biases":"Age"}. This record does not assert independent reproduction.

### CLIP-clip

MS: 0.745. Result ID: 6993f9743a6c3148491a0103.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75c01e209131cea69b51.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ab41e209131cea29e50.md>)

Recorded evaluation configuration: {"Backbone":"ViT-B/16","Biases":"Age"}. This record does not assert independent reproduction.

### Ours

MS: 0.746. Result ID: 6993f9743a6c3148491a0105.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75c01e209131cea69b51.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75c01e209131cea69b51.md>)

Recorded evaluation configuration: {"Backbone":"ViT-B/16","Biases":"Age"}. This record does not assert independent reproduction.

### Original CLIP

MS: 0.749. Result ID: 6993f9743a6c3148491a0112.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75c01e209131cea69b51.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69581e209131cea21ad0.md>)

[Implementation](<https://github.com/OpenAI/CLIP>)

Recorded evaluation configuration: {"Backbone":"ViT-L/14","Biases":"Age"}. This record does not assert independent reproduction.

### Ours

MS: 0.751. Result ID: 6993f9743a6c3148491a010d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75c01e209131cea69b51.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75c01e209131cea69b51.md>)

Recorded evaluation configuration: {"Backbone":"ViT-B/32","Biases":"Age"}. This record does not assert independent reproduction.

### Original CLIP

MS: 0.752. Result ID: 6993f9743a6c3148491a010a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75c01e209131cea69b51.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69581e209131cea21ad0.md>)

[Implementation](<https://github.com/OpenAI/CLIP>)

Recorded evaluation configuration: {"Backbone":"ViT-B/32","Biases":"Age"}. This record does not assert independent reproduction.

### CLIP-clip

MS: 0.753. Result ID: 6993f9743a6c3148491a0113.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75c01e209131cea69b51.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ab41e209131cea29e50.md>)

Recorded evaluation configuration: {"Backbone":"ViT-L/14","Biases":"Age"}. This record does not assert independent reproduction.

### CLIP-clip

MS: 0.754. Result ID: 6993f9743a6c3148491a010b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75c01e209131cea69b51.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ab41e209131cea29e50.md>)

Recorded evaluation configuration: {"Backbone":"ViT-B/32","Biases":"Age"}. This record does not assert independent reproduction.

### Ours

MS: 0.754. Result ID: 6993f9743a6c3148491a0115.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75c01e209131cea69b51.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75c01e209131cea69b51.md>)

Recorded evaluation configuration: {"Backbone":"ViT-L/14","Biases":"Age"}. This record does not assert independent reproduction.

### Original CLIP

MS: 0.764. Result ID: 6993f9743a6c3148491a011a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75c01e209131cea69b51.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69581e209131cea21ad0.md>)

[Implementation](<https://github.com/OpenAI/CLIP>)

Recorded evaluation configuration: {"Backbone":"ViT-H/14","Biases":"Age"}. This record does not assert independent reproduction.

### Ours

MS: 0.766. Result ID: 6993f9743a6c3148491a011d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75c01e209131cea69b51.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75c01e209131cea69b51.md>)

Recorded evaluation configuration: {"Backbone":"ViT-H/14","Biases":"Age"}. This record does not assert independent reproduction.

### CLIP-clip

MS: 0.769. Result ID: 6993f9743a6c3148491a011b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75c01e209131cea69b51.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ab41e209131cea29e50.md>)

Recorded evaluation configuration: {"Backbone":"ViT-H/14","Biases":"Age"}. This record does not assert independent reproduction.

### Biased-prompts

MS: 0.79. Result ID: 6993f9743a6c3148491a011c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75c01e209131cea69b51.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f531e209131cea4511d.md>)

Recorded evaluation configuration: {"Backbone":"ViT-H/14","Biases":"Age"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
