Product poster generation on PosterBenchmark 1.0 (test)
98.53Semantic AccuracyGT
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| GTType=Ground Truth2025.04 | 98.53 | 99.59 | — | — | — | |
| GT (w/ SD3 Rec.)Type=Reconstruction, VAE=SD32025.04 | 98.09 | 99.36 | — | — | — | |
| PosterMakerBase Model=SD32025.04 | 93.36 | 98.39 | 65.35 | 27.04 | 11.57 | |
| GlyphDraw22025.04 | 86.14 | 96.78 | 72.49 | 26.72 | 16.52 | |
| SD3_canny&inpaintBase Model=SD3, Control=Canny Edge2025.04 | 80.75 | 92.75 | 67.19 | 27.03 | 14.38 | |
| GT (w/ SD1.5 Rec.)Type=Reconstruction, VAE=SD1.52025.04 | 76.95 | 89.91 | — | — | — | |
| PosterMakerBase Model=SD1.52025.04 | 72.12 | 88.01 | 68.17 | 26.93 | — | |
| Glyph-ByT5-v22025.04 | 69.54 | 87.65 | 79.23 | 26.6 | 18.91 | |
| AnyTextFramework=Text Editing2025.04 | 63.9 | 82.81 | 71.27 | 26.69 | 19.25 | |
| SD3_inpaint_AnyTextBase Model=SD3, Rendering=AnyText2025.04 | 52.78 | 75.27 | 100.87 | 26.9 | 14.82 | |
| SD3_inpaint_byt5Base Model=SD3, Text Encoder=ByT52025.04 | 52.28 | 86.57 | 65.45 | 26.71 | 14.6 |