# Text-to-Image Generation on Flickr 30K 5,000 samples Source: [Text-to-Image Generation on Flickr 30K 5,000 samples]() Collection index: [llms.txt]() Data updated: 2026-03-06T07:08:17.760Z Evaluation of Text-to-Image Generation models using the 5,000 sample subset of the Flickr30K dataset, measured using FID, CLIP, and SSIM. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Text-to-Image Generation | | Dataset (including any stated split) | Flickr 30K 5,000 samples | | Metric | FID | | Unit | SCALAR | | Direction | Lower is better | | Results loaded | 14 of 14 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [FID](): Lower is better; unit: SCALAR. - [CLIP Score](): Higher is better; unit: PERCENT. - [SSIM](): Higher is better; unit: PERCENT. ## Recorded results | Method | FID | Result date | Report paper | | --- | --- | --- | --- | | Original (SDXL) | 33.95 | Not recorded | 68fa75fe1e209131cea6acad | | Dev (FLUX) | 37.82 | Not recorded | 68fa75fe1e209131cea6acad | | FLUX-Lite | 38.17 | Not recorded | 68fa75fe1e209131cea6acad | | Schnell (FLUX) | 39.7 | Not recorded | 68fa75fe1e209131cea6acad | | EcoDiff | 40.91 | Not recorded | 68fa75fe1e209131cea6acad | | EcoDiff | 42.58 | Not recorded | 68fa75fe1e209131cea6acad | | EcoDiff | 43.25 | Not recorded | 68fa75fe1e209131cea6acad | | DiffPruning | 48.02 | Not recorded | 68fa75fe1e209131cea6acad | | DiffPruning | 54.49 | Not recorded | 68fa75fe1e209131cea6acad | | BK-SDM | 56.17 | Not recorded | 68fa75fe1e209131cea6acad | | Per-Step Loss | 59.52 | Not recorded | 68fa75fe1e209131cea6acad | | Per-Step Loss | 66.57 | Not recorded | 68fa75fe1e209131cea6acad | | DiffPruning | 96.53 | Not recorded | 68fa75fe1e209131cea6acad | | Per-Step Loss | 110.53 | Not recorded | 68fa75fe1e209131cea6acad | ### Original (SDXL) FID: 33.95. Result ID: 69aa7c1e6dbb7075b953b6ef. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Architecture":"SDXL Diffusion U-Net","Sparsity":"0%","#Param":"2.6B","Speedup":"1x","Compute Budget":"-"}. This record does not assert independent reproduction. ### Dev (FLUX) FID: 37.82. Result ID: 69aa7c1e6dbb7075b953b6f4. [Reporting paper]() Recorded evaluation configuration: {"Architecture":"FLUX Flow Matching DiT","Sparsity":"0%","#Param":"11.9B","Speedup":"1x","Compute Budget":"-"}. This record does not assert independent reproduction. ### FLUX-Lite FID: 38.17. Result ID: 69aa7c1e6dbb7075b953b6f6. [Reporting paper]() Recorded evaluation configuration: {"Architecture":"FLUX Flow Matching DiT","Sparsity":"33%","#Param":"8B","Speedup":"1.49x","Compute Budget":"1120hr"}. This record does not assert independent reproduction. ### Schnell (FLUX) FID: 39.7. Result ID: 69aa7c1e6dbb7075b953b6f9. [Reporting paper]() Recorded evaluation configuration: {"Architecture":"FLUX Flow Matching DiT","Sparsity":"0%","#Param":"11.9B","Speedup":"7x","Compute Budget":"-"}. This record does not assert independent reproduction. ### EcoDiff FID: 40.91. Result ID: 69aa7c1e6dbb7075b953b6f3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Architecture":"SDXL Diffusion U-Net","Sparsity":"20%","#Param":"2.1B","Speedup":"1.25x","Compute Budget":"10hr"}. This record does not assert independent reproduction. ### EcoDiff FID: 42.58. Result ID: 69aa7c1e6dbb7075b953b6f8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Architecture":"FLUX Flow Matching DiT (Dev)","Sparsity":"20%","#Param":"9.6B","Speedup":"1.25x","Compute Budget":"10hr"}. This record does not assert independent reproduction. ### EcoDiff FID: 43.25. Result ID: 69aa7c1e6dbb7075b953b6fc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Architecture":"FLUX Flow Matching DiT (Schnell)","Sparsity":"20%","#Param":"9.6B","Speedup":"8.75x","Compute Budget":"10hr"}. This record does not assert independent reproduction. ### DiffPruning FID: 48.02. Result ID: 69aa7c1e6dbb7075b953b6f5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Architecture":"FLUX Flow Matching DiT (Dev)","Sparsity":"20%","#Param":"9.6B","Speedup":"1.25x","Compute Budget":"10hr"}. This record does not assert independent reproduction. ### DiffPruning FID: 54.49. Result ID: 69aa7c1e6dbb7075b953b6fa. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Architecture":"FLUX Flow Matching DiT (Schnell)","Sparsity":"20%","#Param":"9.6B","Speedup":"8.75x","Compute Budget":"10hr"}. This record does not assert independent reproduction. ### BK-SDM FID: 56.17. Result ID: 69aa7c1e6dbb7075b953b6f0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Architecture":"SDXL Diffusion U-Net","Sparsity":"20%","#Param":"2.1B","Speedup":"1.25x","Compute Budget":"10hr"}. This record does not assert independent reproduction. ### Per-Step Loss FID: 59.52. Result ID: 69aa7c1e6dbb7075b953b6f7. [Reporting paper]() Recorded evaluation configuration: {"Architecture":"FLUX Flow Matching DiT (Dev)","Sparsity":"20%","#Param":"9.6B","Speedup":"1.25x","Compute Budget":"10hr"}. This record does not assert independent reproduction. ### Per-Step Loss FID: 66.57. Result ID: 69aa7c1e6dbb7075b953b6fb. [Reporting paper]() Recorded evaluation configuration: {"Architecture":"FLUX Flow Matching DiT (Schnell)","Sparsity":"20%","#Param":"9.6B","Speedup":"8.75x","Compute Budget":"10hr"}. This record does not assert independent reproduction. ### DiffPruning FID: 96.53. Result ID: 69aa7c1e6dbb7075b953b6f1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Architecture":"SDXL Diffusion U-Net","Sparsity":"20%","#Param":"2.1B","Speedup":"1.25x","Compute Budget":"10hr"}. This record does not assert independent reproduction. ### Per-Step Loss FID: 110.53. Result ID: 69aa7c1e6dbb7075b953b6f2. [Reporting paper]() Recorded evaluation configuration: {"Architecture":"SDXL Diffusion U-Net","Sparsity":"20%","#Param":"2.1B","Speedup":"1.25x","Compute Budget":"10hr"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.