Text Rendering on Diptych 1.0 (test)
0.1288Edit DistanceBaseline DPO SDXL 1.0 (Background variation)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Baseline DPO SDXL 1.0 (Background variation)Backbone=SDXL 1.0, Evaluation Strategy=Average, Sample Size (n)=42026.02 | 0.1288 | 74.46 | 4.55 | |
| SFT SDXL 1.0Backbone=SDXL 1.0, Evaluation Strategy=Average, Sample Size (n)=42026.02 | 0.129 | 72.13 | 6.13 | |
| Pretrained SDXL 1.0Backbone=SDXL 1.0, Evaluation Strategy=Average, Sample Size (n)=42026.02 | 0.1305 | 72.15 | 6.19 | |
| Di3PO SDXL 1.0Backbone=SDXL 1.0, Evaluation Strategy=Average, Sample Size (n)=42026.02 | 0.164 | 64.56 | 9.46 | |
| Baseline DPO SDXL 1.0 (Background variation)Backbone=SDXL 1.0, Evaluation Strategy=BoN (Best-of-N), Sample Size (n)=42026.02 | 0.251 | 53.06 | 12.65 | |
| SFT SDXL 1.0Backbone=SDXL 1.0, Evaluation Strategy=BoN (Best-of-N), Sample Size (n)=42026.02 | 0.264 | 47.44 | 17.15 | |
| Pretrained SDXL 1.0Backbone=SDXL 1.0, Evaluation Strategy=BoN (Best-of-N), Sample Size (n)=42026.02 | 0.2678 | 46.77 | 17.36 | |
| Di3PO SDXL 1.0Backbone=SDXL 1.0, Evaluation Strategy=BoN (Best-of-N), Sample Size (n)=42026.02 | 0.3353 | 38.26 | 25.06 | |
| Pretrained SD3Backbone=SD3, Evaluation Strategy=Average, Sample Size (n)=42026.02 | 0.3794 | 67.64 | 8.5 | |
| Di3PO SD3Backbone=SD3, Evaluation Strategy=Average, Sample Size (n)=42026.02 | 0.4734 | 57.58 | 9.55 | |
| Pretrained SD3Backbone=SD3, Evaluation Strategy=BoN (Best-of-N), Sample Size (n)=42026.02 | 0.6363 | 42.44 | 24.8 | |
| Di3PO SD3Backbone=SD3, Evaluation Strategy=BoN (Best-of-N), Sample Size (n)=42026.02 | 0.7228 | 32.5 | 34.36 |