Domain Conversion on NICO++
24.35AUTFREEDOM
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| FREEDOMBackbone=ViT-L/14 image encoder, text_memory=20k words, k=20, n=7, m=72024.12 | 24.35 | 24.41 | 30.06 | 30.51 | 26.92 | 20.37 | 26.1 | |
| MagicLens2024.12 | 18.76 | 15.17 | 22.14 | 23.61 | 21.99 | 16.3 | 19.66 | |
| SEARLE2024.12 | 13.49 | 13.73 | 17.91 | 17.99 | 15.79 | 11.84 | 15.13 | |
| CompoDiff2024.12 | 10.07 | 7.83 | 10.53 | 11.41 | 11.93 | 10.15 | 10.32 | |
| Pic2Word2024.12 | 9.79 | 8.09 | 11.24 | 11.27 | 11.01 | 7.16 | 9.76 | |
| WeiCom2024.12 | 8.58 | 7.39 | 13.04 | 13.17 | 11.32 | 9.73 | 10.54 | |
| Text + ImageMode=Sum baseline2024.12 | 8.46 | 6.58 | 9.22 | 11.91 | 11.2 | 8.41 | 9.3 | |
| Text × ImageMode=Product baseline2024.12 | 8.24 | 6.36 | 12.11 | 12.71 | 10.46 | 8.84 | 9.79 | |
| ImageMode=Unimodal visual-only2024.12 | 6.45 | 4.85 | 5.67 | 7.67 | 7.65 | 5.65 | 6.32 | |
| TextMode=Unimodal text-only2024.12 | 1 | 0.99 | 1.15 | 1.23 | 1.1 | 1.05 | 1.09 |