Reasoning Image Editing on RISEBench 1.0 (test)
34.1Temporal ScoreGPT-4o
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| GPT-4oAccess Type=Closed-source, Chain-of-Thought=false2025.12 | 34.1 | 32.2 | 37 | 10.6 | 28.9 | |
| GPT-Image-1Model Category=Proprietary Models2025.12 | 34.1 | 32.2 | 37 | 10.6 | 28.9 | |
| Gemini-2.5-Flash-ImageModel Category=Proprietary Models2025.12 | 25.9 | 47.8 | 37 | 18.8 | 32.8 | |
| EditThinkerBackbone=Qwen-Image-Edit, Framework=Think-while-Edit, Expert Model=EditThinker-Expert-GPT4.1, Protocol=Oracle Upper Bound2025.12 | 25.9 | 32.2 | 40 | 9.4 | 27.5 | |
| EditThinkerBackbone=OmniGen2, Framework=Think-while-Edit, Expert Model=EditThinker-Expert-GPT4.1, Protocol=Oracle Upper Bound2025.12 | 17.6 | 8.9 | 8 | 2.4 | 9.2 | |
| EditThinkerBackbone=FLUX.1-Kontext-Dev, Framework=Think-while-Edit, Expert Model=EditThinker-Expert-GPT4.1, Protocol=Oracle Upper Bound2025.12 | 16.5 | 24.4 | 33 | 5.9 | 20.6 | |
| ThinkGenAccess Type=Open-source, Chain-of-Thought=true2025.12 | 16.4 | 17.7 | 16 | 1.1 | 13 | |
| Seedream-4.0Model Category=Proprietary Models2025.12 | 12.9 | 12.2 | 11 | 7.1 | 10.8 | |
| EditThinkerBackbone=FLUX.1-Kontext-Dev, Framework=Think-while-Edit, Expert Model=EditThinker-8B2025.12 | 11.8 | 17.8 | 20 | 7.1 | 14.4 | |
| EditThinkerBackbone=Qwen-Image-Edit, Framework=Think-while-Edit, Expert Model=EditThinker-8B2025.12 | 10.8 | 23.3 | 27 | 8.2 | 17.8 | |
| Gemini-2.0Access Type=Closed-source, Chain-of-Thought=false2025.12 | 8.2 | 15.5 | 23 | 4.7 | 13.3 | |
| BAGELAccess Type=Open-source, Chain-of-Thought=true2025.12 | 5.9 | 17.8 | 21 | 1.2 | 11.9 | |
| BAGELModel Category=Open-source Models, Chain-of-Thought=true2025.12 | 5.9 | 17.8 | 21 | 1.2 | 11.9 | |
| Qwen-Image-EditModel Category=Open-source Models2025.12 | 4.7 | 10 | 17 | 2.4 | 8.9 | |
| EditThinkerBackbone=OmniGen2, Framework=Think-while-Edit, Expert Model=EditThinker-8B2025.12 | 4.7 | 7.8 | 5 | 3.5 | 3.4 | |
| Qwen-Image-EditFramework=Think-while-Edit, Testing Protocol=Official model checkpoint test2025.12 | 4.7 | 10 | 17 | 2.4 | 8.9 | |
| BAGELAccess Type=Open-source, Chain-of-Thought=false2025.12 | 3.5 | 4.4 | 9 | 5.9 | 5.8 | |
| ThinkGenAccess Type=Open-source, Chain-of-Thought=false2025.12 | 3.5 | 2.2 | 7 | 1.1 | 3.6 | |
| BAGELModel Category=Open-source Models2025.12 | 2.4 | 5.6 | 14 | 1.2 | 6.1 | |
| OmniGen2Framework=Think-while-Edit, Testing Protocol=Official model checkpoint test2025.12 | 2.4 | 1.1 | 7 | 1.2 | 3.1 | |
| FLUX.1-Kontext-DevModel Category=Open-source Models2025.12 | 2.3 | 5.5 | 13 | 1.2 | 5.8 | |
| FLUX.1-Kontext-DevFramework=Think-while-Edit, Testing Protocol=Official model checkpoint test2025.12 | 2.3 | 5.5 | 13 | 1.2 | 5.8 | |
| OmniGenAccess Type=Open-source, Chain-of-Thought=false2025.12 | 1.2 | 1 | 0 | 1.2 | 0.8 | |
| EMU2Access Type=Open-source, Chain-of-Thought=false2025.12 | 1.2 | 1.1 | 0 | 0 | 0.5 | |
| Ovis-U1Model Category=Open-source Models2025.12 | 1.2 | 3.3 | 4 | 2.4 | 2.8 | |
| Step1X-EditAccess Type=Open-source, Chain-of-Thought=false2025.12 | 0 | 2.2 | 2 | 3.5 | 1.9 | |
| HiDream-EditAccess Type=Open-source, Chain-of-Thought=false2025.12 | 0 | 0 | 0 | 0 | 0 | |
| FLUX-CannyAccess Type=Open-source, Chain-of-Thought=false2025.12 | 0 | 0 | 0 | 0 | 0 | |
| OmniGen2Access Type=Open-source, Chain-of-Thought=false2025.12 | 0 | 2.2 | 7 | 2.3 | 3 | |
| Step1X-EditModel Category=Open-source Models2025.12 | 0 | 2.2 | 2 | 3.5 | 1.9 |