# Text-to-Image Generation on MS-COCO evaluated after 100-concept erasure Source: [Text-to-Image Generation on MS-COCO evaluated after 100-concept erasure]() Collection index: [llms.txt]() Data updated: 2026-05-29T08:24:33.155Z Evaluation of Text-to-Image Generation models using a modified version of the MS-COCO dataset where 100 concepts have been erased from the evaluation set. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Text-to-Image Generation | | Dataset (including any stated split) | MS-COCO evaluated after 100-concept erasure | | Metric | CS | | Unit | SCALAR | | Direction | Higher is better | | Results loaded | 13 of 13 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [CS](): Higher is better; unit: SCALAR. - [FID](): Lower is better; unit: SCALAR. ## Recorded results | Method | CS | Result date | Report paper | | --- | --- | --- | --- | | SD v1.4 | 26.56 | Not recorded | 6a191d66dbd7150506f82671 | | SD v1.4 | 26.53 | Not recorded | 68fa7c231e209131cea8ca66 | | FMN | 26.4 | Not recorded | 6a191d66dbd7150506f82671 | | Orthogonal Concept Erasure | 26.33 | Not recorded | 6a191d66dbd7150506f82671 | | SPEED | 26.29 | Not recorded | 6a191d66dbd7150506f82671 | | SPEED | 26.22 | Not recorded | 68fa7c231e209131cea8ca66 | | ESD | 25.97 | Not recorded | 6a191d66dbd7150506f82671 | | CA | 25.59 | Not recorded | 6a191d66dbd7150506f82671 | | UCE | 25.23 | Not recorded | 6a191d66dbd7150506f82671 | | SPM | 25.15 | Not recorded | 68fa7c231e209131cea8ca66 | | MACE | 24.81 | Not recorded | 6a191d66dbd7150506f82671 | | SPM w/o FT | 14.34 | Not recorded | 68fa7c231e209131cea8ca66 | | RECE | 12.93 | Not recorded | 6a191d66dbd7150506f82671 | ### SD v1.4 CS: 26.56. Result ID: 6a194d31fbc373592c139f82. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"GPU":"A100"}. This record does not assert independent reproduction. ### SD v1.4 CS: 26.53. Result ID: 69a7e8626dbb7075b94ca053. [Reporting paper]() Recorded evaluation configuration: {"Fine-tuning":"N/A"}. This record does not assert independent reproduction. ### FMN CS: 26.4. Result ID: 6a194d31fbc373592c139f85. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"GPU":"A100"}. This record does not assert independent reproduction. ### Orthogonal Concept Erasure CS: 26.33. Result ID: 6a194d31fbc373592c139f8a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"GPU":"A100"}. This record does not assert independent reproduction. ### SPEED CS: 26.29. Result ID: 6a194d31fbc373592c139f89. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"GPU":"A100"}. This record does not assert independent reproduction. ### SPEED CS: 26.22. Result ID: 69a7e8626dbb7075b94ca056. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Fine-tuning":"true"}. This record does not assert independent reproduction. ### ESD CS: 25.97. Result ID: 6a194d31fbc373592c139f84. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"GPU":"A100"}. This record does not assert independent reproduction. ### CA CS: 25.59. Result ID: 6a194d31fbc373592c139f83. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"GPU":"A100"}. This record does not assert independent reproduction. ### UCE CS: 25.23. Result ID: 6a194d31fbc373592c139f86. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"GPU":"A100"}. This record does not assert independent reproduction. ### SPM CS: 25.15. Result ID: 69a7e8626dbb7075b94ca054. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Fine-tuning":"true"}. This record does not assert independent reproduction. ### MACE CS: 24.81. Result ID: 6a194d31fbc373592c139f87. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"GPU":"A100"}. This record does not assert independent reproduction. ### SPM w/o FT CS: 14.34. Result ID: 69a7e8626dbb7075b94ca055. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Fine-tuning":"false"}. This record does not assert independent reproduction. ### RECE CS: 12.93. Result ID: 6a194d31fbc373592c139f88. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"GPU":"A100"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.