Local Image Editing on MagicBrush (dev)
0.0463L1 ErrorOurs(variant G, deployed)
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Ours(variant G, deployed)Masking strategy=Mask-free, Variant=G2026.04 | 0.0463 | 0.018 | 0.9365 | 0.9192 | 0.2011 | |
| ACE (SDXL)Masking strategy=Mask-free, Backbone=SDXL2026.04 | 0.0507 | 0.0165 | 0.9453 | 0.9215 | — | |
| AnyEdit (AnySD)Masking strategy=Mask-free2026.04 | 0.051 | — | 0.898 | 0.881 | — | |
| EditMGTMasking strategy=Mask-free2026.04 | 0.058 | — | 0.911 | 0.881 | — | |
| PixWizardMasking strategy=Mask-free2026.04 | 0.063 | — | 0.884 | 0.876 | — | |
| UltraEdit-SD3 (w/ mask)Masking strategy=Mask-conditioned (oracle mask)2026.04 | 0.0695 | 0.0189 | 0.8721 | 0.8507 | 0.2027 | |
| MagicBrushMasking strategy=Mask-free2026.04 | 0.0733 | 0.0263 | 0.8987 | 0.8704 | 0.2013 | |
| UniRealMasking strategy=Mask-free2026.04 | 0.081 | — | 0.903 | 0.837 | — | |
| Qwen-Image-Edit (vanilla)Masking strategy=Mask-free, Variant=vanilla2026.04 | 0.0816 | 0.0301 | 0.9016 | 0.8575 | 0.2131 | |
| VAREdit-8BMasking strategy=Mask-free, Parameters=8B2026.04 | 0.083 | — | 0.901 | 0.844 | — | |
| UltraEdit-SD3 (free-form)Masking strategy=Mask-free, Variant=free-form2026.04 | 0.0944 | 0.028 | 0.8192 | 0.7535 | 0.2103 | |
| InstructPix2PixMasking strategy=Mask-free2026.04 | 0.1126 | 0.0359 | 0.8409 | 0.7498 | 0.2059 |