Open-Ended Image Editing on MadVerse (test)
4.196Instruction FollowingPlan2Pix
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Plan2Pix2026.05 | 4.196 | 3.155 | 2.525 | |
| Plan2PixEvaluation Judge=Gemini-3-Pro2026.05 | 4.196 | 3.155 | 2.525 | |
| Qwen-Image-Edit-2511Input Strategy=Qwen3-VL-8B Plan, Evaluation Judge=Gemini-3-Pro2026.05 | 3.807 | 3.005 | 2.16 | |
| Qwen-Image-Edit-2511Input Strategy=High-Level Instruction, Evaluation Judge=Gemini-3-Pro2026.05 | 3.355 | 2.769 | 2.26 | |
| FLUX.1-Kontext-devInput Strategy=Qwen3-VL-8B Plan, Evaluation Judge=Gemini-3-Pro2026.05 | 3.33 | 3.005 | 2.405 | |
| FLUX.1-Kontext-devInput Strategy=High-Level Instruction, Evaluation Judge=Gemini-3-Pro2026.05 | 2.32 | 4.32 | 3.525 | |
| GenArtist2026.05 | 1.252 | 1.007 | 1.66 |