Video Object Removal on real-world videos
4.49Temporal Consistency ScoreRunway
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| RunwayJudge=Gemini-3 Pro2026.04 | 4.49 | 2.61 | 4.62 | 4.16 | 4.82 | 4.35 | 25.05 | — | — | |
| VOIDJudge=Gemini-3 Pro2026.04 | 4.44 | 3.66 | 4.82 | 4.1 | 4.88 | 4.22 | 26.13 | — | — | |
| Gen-OmnimatteJudge=Gemini-3 Pro2026.04 | 4.32 | 2.3 | 4.75 | 3.81 | 4.92 | 4.23 | 24.34 | — | — | |
| MiniMax-RemoverJudge=Gemini-3 Pro2026.04 | 4.3 | 1.94 | 4.47 | 3.7 | 4.8 | 4.24 | 23.46 | — | — | |
| ROSEJudge=Gemini-3 Pro2026.04 | 4.26 | 2.25 | 4.77 | 3.86 | 4.92 | 4.17 | 24.22 | — | — | |
| VOIDJudge=Qwen3.5-32B2026.04 | 4.24 | 2.64 | 4.75 | 3.55 | 5 | 4.12 | 24.49 | — | — | |
| ROSEJudge=Qwen3.5-32B2026.04 | 4.17 | 1.75 | 4.45 | 3.41 | 4.93 | 4.04 | 22.96 | — | — | |
| DiffuEraserJudge=Gemini-3 Pro2026.04 | 4.12 | 1.48 | 4.43 | 3.53 | 4.84 | 4.13 | 22.53 | — | — | |
| Gen-OmnimatteJudge=Qwen3.5-32B2026.04 | 4.08 | 2.19 | 4.89 | 3.16 | 5 | 4.05 | 23.44 | — | — | |
| RunwayJudge=Qwen3.5-32B2026.04 | 4.07 | 2.03 | 4.25 | 3.36 | 4.95 | 4.05 | 22.79 | — | — | |
| MiniMax-RemoverJudge=Qwen3.5-32B2026.04 | 4.03 | 1.68 | 4.6 | 3.12 | 5 | 4.03 | 22.45 | — | — | |
| DiffuEraserJudge=Qwen3.5-32B2026.04 | 4 | 2.19 | 4.75 | 3.04 | 5 | 4 | 23.04 | — | — | |
| ProPainterJudge=Qwen3.5-32B2026.04 | 3.89 | 1.93 | 4.43 | 2.96 | 5 | 4 | 22.21 | — | — | |
| VOIDJudge=GPT-5.22026.04 | 3.88 | 3.19 | 4.35 | 3.48 | 4.41 | 3.81 | 23.16 | — | — | |
| ProPainterJudge=Gemini-3 Pro2026.04 | 3.64 | 0.82 | 3.81 | 2.64 | 4.81 | 3.35 | 19.05 | — | — | |
| RunwayJudge=GPT-5.22026.04 | 3.48 | 1.85 | 3.59 | 3.6 | 3.75 | 3.89 | 20.21 | — | — | |
| Gen-OmnimatteJudge=GPT-5.22026.04 | 3.31 | 1.33 | 4.05 | 3.25 | 3.56 | 3.73 | 19.23 | — | — | |
| ROSEJudge=GPT-5.22026.04 | 2.93 | 1.39 | 4.13 | 2.95 | 3.51 | 3.67 | 18.59 | — | — | |
| DiffuEraserJudge=GPT-5.22026.04 | 2.79 | 0.97 | 3.53 | 2.67 | 3.32 | 3.64 | 17 | — | — | |
| MiniMax-RemoverJudge=GPT-5.22026.04 | 2.71 | 0.81 | 3.49 | 2.51 | 3.17 | 3.67 | 16.31 | — | — | |
| ProPainterJudge=GPT-5.22026.04 | 2.44 | 0.76 | 2.91 | 2.11 | 3.13 | 3.2 | 14.55 | — | — | |
| GIVE2026.06 | 0.991 | — | — | — | — | — | 0.5302 | 0.9742 | 76.42 | |
| ROSE2026.06 | 0.9894 | — | — | — | — | — | 0.5106 | 0.9679 | 21.75 | |
| ProPainter2026.06 | 0.9862 | — | — | — | — | — | 0.5188 | 0.9587 | 1.41 | |
| VACE2026.06 | 0.9795 | — | — | — | — | — | 0.5079 | 0.9488 | 0.42 |