Object Removal on RemovalBench (FID, CMMD, LPIPS, PSNR, SSIM, CFD)
41.179FIDOmniPaint
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| OmniPaintLatency (s)=30.59, Mask Protocol=object-only masks2026.06 | 41.179 | 0.0273 | 0.2135 | 24.599 | 74.88 | 0.218 | |
| OSOR(FLUX)Latency (s)=0.93, Mask Protocol=object-only masks2026.06 | 43.8899 | 0.03 | 0.1972 | 25.803 | 76.12 | 0.181 | |
| ObjectClearLatency (s)=10.16, Mask Protocol=object-only masks2026.06 | 49.2744 | 0.0335 | 0.2871 | 25.884 | 77.26 | 0.181 | |
| OSOR(SDXL)Latency (s)=0.43, Mask Protocol=object-only masks2026.06 | 63.6405 | 0.0709 | 0.3313 | 24.676 | 69.43 | 0.1585 | |
| OmniEraserLatency (s)=14.39, Mask Protocol=object-only masks2026.06 | 65.4691 | 0.3066 | 0.2929 | 23.03 | 67.12 | 0.1835 | |
| AttentiveEraserLatency (s)=8.69, Mask Protocol=object-only masks2026.06 | 80.3447 | 0.1788 | 0.1942 | 23.787 | 70.02 | 0.2094 | |
| SDXL-INPLatency (s)=6.03, Mask Protocol=object-only masks2026.06 | 165.4925 | 0.4756 | 0.3388 | 16.983 | 62.51 | 0.3227 | |
| CLIPAwayLatency (s)=5.96, Mask Protocol=object-only masks2026.06 | 169.045 | 0.4072 | 0.3787 | 20.461 | 65.37 | 0.3569 | |
| FLUX-FillLatency (s)=25.27, Mask Protocol=object-only masks2026.06 | 178.6896 | 0.4454 | 0.2695 | 20.277 | 70.99 | 0.3984 |