Text-to-Image Generation Evaluation Set
1.54Mismatch Rate (M/F)SFID (HC)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| SFID (HC)Base Model=SDXL, Debiasing Config=HC2024.10 | 1.54 | 0.84 | 1.74 | 81.57 | |
| SFID (LC)Base Model=SDXL, Debiasing Config=LC2024.10 | 1.69 | 0.96 | 1.97 | 81.57 | |
| CLIP-clipBase Model=SDXL2024.10 | 3.78 | 2.11 | 4.31 | 82.05 | |
| SFID (LC)Base Model=CoDi, Debiasing Config=LC2024.10 | 3.83 | 4.64 | 6.22 | 82.17 | |
| BaselineBase Model=SDXL2024.10 | 3.87 | 2.35 | 4.42 | 83.25 | |
| BaselineBase Model=CoDi2024.10 | 3.94 | 5.54 | 6.85 | 84.94 | |
| SFID (HC)Base Model=CoDi, Debiasing Config=HC2024.10 | 4.7 | 2.59 | 5.38 | 82.77 | |
| CLIP-clipBase Model=CoDi2024.10 | 4.73 | 5 | 7.01 | 84.58 | |
| DEARBase Model=CoDi2024.10 | 5.63 | 5.42 | 8.05 | 86.14 | |
| Prompt-DebiasBase Model=CoDi2024.10 | 20.11 | 41.99 | 46.77 | 81.57 | |
| Prompt-DebiasBase Model=SDXL2024.10 | 39.72 | 42.53 | 58.49 | 82.77 | |
| DEARBase Model=SDXL2024.10 | 89.28 | 44.64 | 99.81 | 99.88 |