Instructive image editing on EMU Edit (test)
0.923CLIP Image SimilarityReasonBrain
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| ReasonBrain2025.07 | 0.923 | 0.126 | 0.302 | 0.051 | 0.898 | — | — | |
| UniDFlow2026.02 | 0.921 | — | 0.362 | — | 0.862 | — | — | |
| FireEdit2025.03 | 0.914 | 0.2783 | — | 0.0574 | 0.8829 | 0.1373 | 78.67 | |
| Emma2026.02 | 0.911 | — | 0.311 | — | 0.834 | — | — | |
| Ours(variant G, deployed)Masking strategy=Mask-free, Variant=G2026.04 | 0.8956 | 0.2304 | — | 0.0698 | 0.8802 | — | — | |
| ACE (SDXL)Masking strategy=Mask-free, Backbone=SDXL2026.04 | 0.8952 | 0.2746 | — | 0.0761 | 0.862 | — | — | |
| MammothModa22026.02 | 0.891 | — | 0.322 | — | 0.844 | — | — | |
| FLUX.1 Kontext-Pro2026.02 | 0.88 | — | — | — | 0.808 | — | — | |
| EditMGTModel Category=Universal model2025.12 | 0.878 | — | 0.308 | 0.093 | 0.832 | — | — | |
| EditMGTMasking strategy=Mask-free2026.04 | 0.878 | 0.308 | — | 0.093 | 0.832 | — | — | |
| OmniGen22026.02 | 0.876 | — | 0.309 | — | 0.822 | — | — | |
| OminiGen2Model Category=Universal model2025.12 | 0.876 | — | 0.309 | — | 0.822 | — | — | |
| VAREdit-8BModel Category=Universal model2025.12 | 0.876 | — | 0.28 | 0.094 | 0.825 | — | — | |
| OmniGen2Masking strategy=Mask-free2026.04 | 0.876 | 0.309 | — | — | 0.822 | — | — | |
| VAREdit-8BMasking strategy=Mask-free, Parameters=8B2026.04 | 0.876 | 0.28 | — | 0.094 | 0.825 | — | — | |
| AnySD w/ AnyEditBackbone=AnySD, Training Data=AnyEdit2024.11 | 0.872 | — | 0.285 | 0.07 | 0.821 | — | — | |
| AnyEditModel Category=Task-specific2025.12 | 0.872 | — | 0.285 | 0.07 | 0.821 | — | — | |
| AnyEdit (AnySD)Masking strategy=Mask-free2026.04 | 0.872 | 0.285 | — | 0.07 | 0.821 | — | — | |
| NEPModel Category=Universal model2025.12 | 0.871 | — | 0.307 | 0.078 | 0.844 | — | — | |
| CARE-EditCategory=Unified Models, Venue=–, Backbone=FLUX.1 Dev2026.03 | 0.868 | — | 0.313 | 0.082 | 0.835 | — | — | |
| SmartFreeEdit2025.07 | 0.868 | 0.115 | 0.261 | 0.078 | 0.832 | — | — | |
| MagicBrush2025.03 | 0.867 | 0.2744 | — | 0.0991 | 0.781 | 0.2551 | 5 | |
| SD1.5 w/ AnyEditBackbone=Stable Diffusion 1.5, Training Data=AnyEdit2024.11 | 0.866 | — | 0.284 | 0.095 | 0.812 | — | — | |
| AnyEditCategory=Unified Models, Venue=CVPR’25, Backbone=SD1.52026.03 | 0.866 | — | 0.284 | 0.095 | 0.812 | — | — | |
| OmniGen2Category=Unified Models, Venue=CVPR’25, Backbone=FLUX.1 Dev2026.03 | 0.865 | — | 0.306 | 0.088 | 0.832 | — | — | |
| GoT-6BModel Category=Universal model2025.12 | 0.864 | — | 0.276 | — | — | — | — | |
| MIGE2025.07 | 0.862 | 0.112 | 0.255 | 0.082 | 0.825 | — | — | |
| GPT Image 1.52025.07 | 0.861 | 0.11 | 0.254 | 0.067 | 0.806 | — | — | |
| Qwen-Image-Edit2025.07 | 0.86 | 0.111 | 0.253 | 0.068 | 0.822 | — | — | |
| SmartEdit2025.03 | 0.8592 | 0.274 | — | 0.1186 | 0.7705 | 0.2717 | 3.33 | |
| EMU EditModel Type=Task-specific2024.12 | 0.859 | 0.109 | 0.231 | 0.094 | 0.819 | — | — | |
| EMU-Edit2024.11 | 0.859 | — | 0.231 | 0.094 | 0.819 | — | — | |
| EMU EditModel Category=Task-specific2025.12 | 0.859 | — | 0.231 | 0.094 | 0.819 | — | — | |
| EMU-EditCategory=Task-specific Models, Venue=CVPR’24, Backbone=–2026.03 | 0.859 | — | 0.231 | 0.094 | 0.819 | — | — | |
| Emu-EditMasking strategy=Mask-free2026.04 | 0.859 | 0.231 | — | 0.094 | 0.819 | — | — | |
| Emu Edit2025.07 | 0.859 | 0.109 | 0.231 | 0.094 | 0.819 | — | — | |
| SmartEdit2025.07 | 0.858 | 0.092 | 0.274 | 0.119 | 0.771 | — | — | |
| IP2P2025.03 | 0.857 | 0.2715 | — | 0.1225 | 0.7616 | 0.2723 | 1.83 | |
| UniRealModel Type=Universal2024.12 | 0.851 | 0.127 | 0.285 | 0.099 | 0.79 | — | — | |
| UniRealModel Category=Universal model2025.12 | 0.851 | — | 0.285 | 0.099 | 0.79 | — | — | |
| UniRealMasking strategy=Mask-free2026.04 | 0.851 | 0.285 | — | 0.099 | 0.79 | — | — | |
| Flux Kontext2025.07 | 0.85 | 0.105 | 0.246 | 0.072 | 0.797 | — | — | |
| Bagel-Thinking2025.07 | 0.846 | 0.103 | 0.243 | 0.073 | 0.794 | — | — | |
| PixWizardModel Type=Universal2024.12 | 0.845 | 0.104 | 0.248 | 0.069 | 0.798 | — | — | |
| UltraEditBackbone=SD32024.11 | 0.845 | — | 0.283 | 0.071 | 0.794 | — | — | |
| PixWizardModel Category=Universal model2025.12 | 0.845 | — | 0.248 | 0.069 | 0.798 | — | — | |
| PixWizardMasking strategy=Mask-free2026.04 | 0.845 | 0.248 | — | 0.069 | 0.798 | — | — | |
| PixWizard2025.07 | 0.845 | 0.104 | 0.248 | 0.069 | 0.798 | — | — | |
| UltraEdit-SD3 (free-form)Masking strategy=Mask-free, Variant=free-form2026.04 | 0.8446 | 0.283 | — | 0.0713 | 0.7937 | — | — | |
| UltraEdit2025.07 | 0.844 | 0.107 | 0.283 | 0.071 | 0.793 | — | — | |
| ChatGPT-4o2025.07 | 0.843 | 0.102 | 0.242 | 0.074 | 0.788 | — | — | |
| Bagel2025.07 | 0.842 | 0.101 | 0.24 | 0.075 | 0.79 | — | — | |
| Bagel2026.02 | 0.839 | — | 0.307 | — | 0.753 | — | — | |
| MagicBrushModel Type=Task-specific2024.12 | 0.838 | 0.09 | 0.222 | 0.1 | 0.776 | — | — | |
| SD1.5 w/ MagicBrushBackbone=Stable Diffusion 1.5, Training Data=MagicBrush2024.11 | 0.838 | — | 0.222 | 0.1 | 0.776 | — | — | |
| MagicBrushModel Category=Task-specific2025.12 | 0.838 | — | 0.222 | 0.1 | 0.776 | — | — | |
| MagicBrushMasking strategy=Mask-free2026.04 | 0.838 | 0.222 | — | 0.1 | 0.776 | — | — | |
| MagicBrush2025.07 | 0.838 | 0.09 | 0.222 | 0.1 | 0.776 | — | — | |
| OmniGenModel Category=Universal model2025.12 | 0.836 | — | 0.233 | — | 0.804 | — | — | |
| InstructPix2PixModel Type=Task-specific2024.12 | 0.834 | 0.078 | 0.219 | 0.121 | 0.762 | — | — | |
| InstructPix2Pix2024.11 | 0.834 | — | 0.219 | 0.121 | 0.762 | — | — | |
| InstructPix2PixModel Category=Task-specific2025.12 | 0.834 | — | 0.219 | 0.121 | 0.762 | — | — | |
| InstructPix2PixCategory=Task-specific Models, Venue=CVPR’23, Backbone=SD1.52026.03 | 0.834 | — | 0.219 | 0.121 | 0.762 | — | — | |
| InstructPix2PixMasking strategy=Mask-free2026.04 | 0.834 | 0.219 | — | 0.1213 | 0.762 | — | — | |
| InstructPix2Pix2025.07 | 0.834 | 0.078 | 0.219 | 0.121 | 0.762 | — | — | |
| ACE (ACE++)Category=Unified Models, Venue=ICLR’26, Backbone=FLUX.1 Fill2026.03 | 0.831 | — | 0.256 | 0.073 | 0.802 | — | — | |
| UltraEdit2025.03 | 0.812 | 0.2773 | — | 0.0838 | 0.7406 | 0.2826 | 5 | |
| UltraEditModel Category=Task-specific2025.12 | 0.793 | — | 0.283 | 0.071 | 0.844 | — | — | |
| OmniGenModel Type=Universal2024.12 | 0.792 | 0.088 | 0.261 | 0.052 | 0.879 | — | — | |
| UltraEditModel Type=Task-specific2024.12 | 0.761 | 0.101 | 0.236 | 0.075 | 0.678 | — | — | |
| Null-Text2024.11 | 0.761 | — | 0.236 | 0.075 | 0.678 | — | — | |
| Null-Text Inv.Model Category=Task-specific2025.12 | 0.761 | — | 0.236 | 0.075 | 0.678 | — | — | |
| Null-TextCategory=Task-specific Models, Venue=CVPR’23, Backbone=SD1.52026.03 | 0.761 | — | 0.236 | 0.075 | 0.678 | — | — | |
| MGIE2025.07 | 0.746 | 0.083 | 0.231 | 0.163 | 0.594 | — | — | |
| MGIE2025.03 | 0.7456 | 0.2314 | — | 0.1628 | 0.5944 | 0.3801 | 1.25 | |
| HQ-Edit2025.03 | 0.7095 | 0.2566 | — | 0.2541 | 0.5404 | 0.5397 | 4.92 | |
| FLUX.1 FillCategory=Unified Models, Venue=HuggingFace, Backbone=FLUX.1 Fill2026.03 | 0.663 | — | 0.205 | 0.176 | 0.674 | — | — | |
| Null-Text Inv.Model Type=Task-specific2024.12 | 0.521 | 0.028 | — | — | — | — | — | |
| PnP2024.11 | 0.521 | — | 0.089 | 0.304 | 0.568 | — | — | |
| PnPModel Category=Task-specific2025.12 | 0.521 | — | 0.089 | 0.304 | 0.153 | — | — | |
| PnPCategory=Task-specific Models, Venue=CVPR’23, Backbone=SD1.52026.03 | 0.521 | — | 0.089 | 0.089 | 0.304 | — | — | |
| PnPModel Type=Task-specific2024.12 | 0.304 | 0.089 | 0.153 | — | — | — | — | |
| ACEModel Type=Universal2024.12 | 0.289 | 0.101 | 0.22 | — | — | — | — |