Object Removal on ICOREval
93.7DINO ScoreREORM (GPT-4o)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| REORM (GPT-4o)Backbone=GPT-4o, Model Type=Proposed, Runtime (s/img)=13.15(API) + 4.332026.02 | 93.7 | 0.104 | 27.063 | 82.5 | |
| REORM (LLaVA + Llama)Backbone=LLaVA + Llama, Model Type=Proposed, Runtime (s/img)=12.542026.02 | 89.7 | 0.121 | 25.674 | 82 | |
| Nano BananaModel Type=Closed-source (API), Runtime (s/img)=8.45 (API)2026.02 | 87.3 | 0.124 | 25.225 | 77.1 | |
| GPT Image 1Model Type=Closed-source (API), Runtime (s/img)=21.12 (API)2026.02 | 78.9 | 0.347 | 18.352 | 53.5 | |
| SmartEditModel Type=Open-source (locally run), Runtime (s/img)=10.092026.02 | 76 | 0.275 | 20.064 | 61.5 | |
| MGIEModel Type=Open-source (locally run), Runtime (s/img)=5.202026.02 | 70.9 | 0.261 | 19.217 | 63.4 |